-- Logs begin at Mon 2022-04-11 12:18:06 UTC, end at Mon 2022-04-11 13:40:01 UTC. -- Apr 11 12:57:50.295741 dv-cinder-836973-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 11 12:57:50.304380 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 12:57:50 2022] *** Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: nodename: dv-cinder-836973-2-iscsi Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: machine: x86_64 Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: clock source: unix Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: pcre jit disabled Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: detected number of CPU cores: 4 Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: current working directory: / Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: detected binary path: /usr/bin/uwsgi-core Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: your processes number limit is 47680 Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: your memory page size is 4096 bytes Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: detected max file descriptor number: 2048 Apr 11 12:57:50.306340 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: lock engine: pthread robust mutexes Apr 11 12:57:50.307832 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: thunder lock: enabled Apr 11 12:57:50.307832 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 11 12:57:50.307832 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 12:57:50.352810 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: Python main interpreter initialized at 0x55649aee09c0 Apr 11 12:57:50.352810 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: python threads support enabled Apr 11 12:57:50.352810 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: your server socket listen backlog is limited to 100 connections Apr 11 12:57:50.352810 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: your mercy for graceful operations on workers is 90 seconds Apr 11 12:57:50.353186 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 12:57:50.353260 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: *** Operational MODE: preforking *** Apr 11 12:57:50.353504 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: *** uWSGI is running in multiple interpreter mode *** Apr 11 12:57:50.353504 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: spawned uWSGI master process (pid: 80213) Apr 11 12:57:50.353711 dv-cinder-836973-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 11 12:57:50.356217 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: spawned uWSGI worker 1 (pid: 80226, cores: 1) Apr 11 12:57:50.356217 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: spawned uWSGI worker 2 (pid: 80227, cores: 1) Apr 11 12:57:50.356217 dv-cinder-836973-2-iscsi devstack@keystone.service[80213]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 12:57:56.267526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 12:57:56.267526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: from cryptography.utils import int_from_bytes Apr 11 12:57:56.268306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 12:57:56.268306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: from cryptography.utils import int_from_bytes Apr 11 12:57:56.279880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 12:57:56.279880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: from cryptography.utils import int_from_bytes Apr 11 12:57:56.280348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 12:57:56.280348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: from cryptography.utils import int_from_bytes Apr 11 12:57:56.319101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 12:57:56.319301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 12:57:56.319495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] command line args: [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 12:57:56.319770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 12:57:56.319950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ================================================================================ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 12:57:56.320210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] admin_token = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.320463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] config_dir = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.320655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.320839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] config_source = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.321022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] debug = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.321224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.321718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.321803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.322021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.322300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.322538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.322720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_config_append = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.322901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.323080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_dir = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.323260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.323501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.324321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.324598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.324851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.325032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.325212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.325466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.325719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.325959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.326222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.326462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.326700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.326952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.327203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.327485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.327981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.328161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 12:57:56.328255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] publish_errors = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.328358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 12:57:56.328435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.328549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] command line args: [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 12:57:56.328632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.328789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.328901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 12:57:56.329041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.329160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ================================================================================ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 12:57:56.329283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.329393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] admin_token = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.329523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] standard_threads = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.329712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] config_dir = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.329795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.329944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] config_source = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] use_journal = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] debug = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] use_json = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] use_stderr = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] use_syslog = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.330977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.331081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.331201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.331343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.331525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.331602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.331839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.331919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.332087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.332175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.332343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.332425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_config_append = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.332559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.332634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.332779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_dir = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.332866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.332998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.333073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.333307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.333382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.333628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.333779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.333900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.333972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.334143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.334321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.334414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.334554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.334632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.334796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.334874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.335130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.335213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.335374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.335450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.335638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.335758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.335900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.336067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.336205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.336367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.336454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.336632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.336728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.336899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.336978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.337160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.337283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.337417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.337656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.337738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.337895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.338153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.338294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.338433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] publish_errors = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.338556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.338686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.338810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.338933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.339064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.339186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.339308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.340130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.340225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.340302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.340449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.340573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] standard_threads = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.340646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.340703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.340770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.340845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.340922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.340992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.341165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] use_journal = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.341242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.341340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] use_json = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.341416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.341516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] use_stderr = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.341634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.341711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] use_syslog = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.341874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.341951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 12:57:56.342138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.342933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.343905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.344898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345748 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.345988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.346976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.347059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.347209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.347294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.347475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.347566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.347976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348681 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.348997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.349879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.350858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.351992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.352983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.353929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.354898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.355877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.356871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.external = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.357859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.password = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.358874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] auth.token = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.359842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.360962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.361996 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.362995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.363961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364123 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364200 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.364926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.365930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.366921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.external = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.367910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.368894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.password = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] auth.token = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369845 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.369990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.370068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.370264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.370345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.370498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.371884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.372853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.373980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.374877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375824 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.375983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.376965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.377995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.378921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.379953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.382377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.382516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.382617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.382714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.382811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.382922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.383896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.384964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385105 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.385955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.386024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.386092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.386213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.386932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.387978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.388953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.389926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.390928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.391899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] role.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.392876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] role.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.393964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.394961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.395998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.396907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.397892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.398953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.399883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.400847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.401989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] role.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.402975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] role.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.403939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.404991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.405955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.406928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.407893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.408878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.409982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.410060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.410243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.410324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.410417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80227) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 12:57:56.410496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.410723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.410959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.411199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.411435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.411674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.411926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.412177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.412437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.412687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.412926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.413171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.413415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.413667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.413905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.414164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.414403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.414649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.414898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.415128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.415370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.415679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.415942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.416187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.416436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.416674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.416915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.417149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.417391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.417933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.418199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.418450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.418688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.418933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.419171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.419420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.419654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.419898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.420128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.420368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.420602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 12:57:56.420771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 12:57:56.440939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.441179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.441411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.446657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.446890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.447115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.450676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.456256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.479564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.479797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.482915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.483168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.535301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.535799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.584968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.585193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.585966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.586236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.654952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.655035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.655166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.655248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.655383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.679982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.680072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.680190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.680275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.680410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.680493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.680626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.692386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.692490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.705834 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.706945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.707024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.707156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.707237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80227) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.707366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 12:57:56.724953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.725160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 12:57:56.725256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.725371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 12:57:56.725495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.725693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 12:57:56.725772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.725900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 12:57:56.725980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.726984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.738255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.738528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.738608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.738793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.738874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.739059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.739138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.739341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.748106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.748387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.751428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.751664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.751820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.752972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.753949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.754028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.754243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.754326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.754505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.781201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.781300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.782840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.782927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.783117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.783199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.788386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.788475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.788623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.788705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.788898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.788979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.796749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.797025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.797108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.797348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.801599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.801883 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.802046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.802258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.802342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.802540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.802620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.802808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.802900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.803864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.822290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.822571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.822876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.823156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.827843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.828344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.831498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.831784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.832040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.832338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.836781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.837382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.842600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.843216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.846255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.846548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.846827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.846909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.847103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.847186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.847383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.847467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.847664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.847996 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.848243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.848522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.969596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.969897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.969987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.970192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.970278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.970463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.970560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.970842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.978607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.978954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.980827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.981175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.981329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.981600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.984236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.984520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.984627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.984906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.984987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.985247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.985337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.985524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.985614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.985874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.999386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.999661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:56.999744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:56.999934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.000840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.001036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.001116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.001313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.019302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.019717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.022605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.022966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.025936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.026295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.027643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.027911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.029413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.029658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.029739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.029930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.030012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.030236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.037279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.037569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.038961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.039188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.042171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.042412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.043063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.043244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.043370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.043518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.043600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.043785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.052747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.053012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.053093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.053308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.053386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.053584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.061413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80227) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.061675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 12:57:57.061768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.061949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.062050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.062254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.062363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.062527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.062751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.062833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.063081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.063164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.063363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.063492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.063633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.063774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064834 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.064945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.065095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80227) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.065215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.065479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.065749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 12:57:57.103983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55649aee09c0 pid: 80227 (default app) Apr 11 12:57:57.104381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55649aee09c0 pid: 80226 (default app) Apr 11 12:57:57.107771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399381-5a7b-4abf-b61c-20a8cc7a1751 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:57:57.108069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399381-5a7b-4abf-b61c-20a8cc7a1751 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:57:57.108351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399381-5a7b-4abf-b61c-20a8cc7a1751 None None] PATH_INFO: `/v3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:57:57.112614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Mon Apr 11 12:57:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:06.017896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0c85-3c8a-41cc-ae5a-7bb3bd4d887a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:06.018509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0c85-3c8a-41cc-ae5a-7bb3bd4d887a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:06.018509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0c85-3c8a-41cc-ae5a-7bb3bd4d887a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:06.022780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:06.027886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:06.028299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:06.028443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:06.059966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG oslo_db.sqlalchemy.engines [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80227) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 12:58:06.241646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG passlib.handlers.bcrypt [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80227) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 12:58:06.255534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG passlib.handlers.bcrypt [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80227) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 12:58:06.297558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:06.299190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:06.423031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 11 12:58:06.604735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0c85-3c8a-41cc-ae5a-7bb3bd4d887a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:06.638495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8f0c85-3c8a-41cc-ae5a-7bb3bd4d887a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 12:58:06.766739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0c85-3c8a-41cc-ae5a-7bb3bd4d887a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:06.770993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:06.771647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:06.771930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:06.772206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:06.780280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:06.830554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 12:58:06.830897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22232c2-c430-48dd-b247-b670868eeda9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:06.840251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Apr 11 12:58:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 12:58:06.848266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:06.863242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f066b-2a94-416b-8788-fc634b3ebed4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:06.867593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:06.868729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:06.869017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:06.869298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] PATH_INFO: `/v3/projects/1a113afb28034953938db4779ef8e6eb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:06.870833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] RBAC: Authorizing `identity:get_project(project_id=1a113afb28034953938db4779ef8e6eb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:06.923286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 12:58:06.923636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5cf62-7889-4e91-9e59-24bc365d262a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:06.928255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Mon Apr 11 12:58:06 2022] GET /identity/v3/projects/1a113afb28034953938db4779ef8e6eb => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:09.198706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697ce9-b700-489c-b59e-1781a6ba14d9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:09.199217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697ce9-b700-489c-b59e-1781a6ba14d9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:09.199323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697ce9-b700-489c-b59e-1781a6ba14d9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:09.203366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:09.208670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:09.209056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:09.209234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:09.228292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:09.229817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:09.238223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 11 12:58:09.260016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697ce9-b700-489c-b59e-1781a6ba14d9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:09.271844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697ce9-b700-489c-b59e-1781a6ba14d9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:09.276071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2ca55-0e0e-4f5a-83bd-cd89259a4a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:09.276697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2ca55-0e0e-4f5a-83bd-cd89259a4a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:09.276980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2ca55-0e0e-4f5a-83bd-cd89259a4a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:09.277257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2ca55-0e0e-4f5a-83bd-cd89259a4a66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:09.285282 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2ca55-0e0e-4f5a-83bd-cd89259a4a66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:09.287087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2ca55-0e0e-4f5a-83bd-cd89259a4a66 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:09.296725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Apr 11 12:58:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 12:58:09.303432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:09.312560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d514fd4-4d30-4c31-94b1-02354bd10258 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:09.316967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc895fe2-6996-4427-b43e-22f82f9e1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:09.318012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc895fe2-6996-4427-b43e-22f82f9e1324 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:09.318414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc895fe2-6996-4427-b43e-22f82f9e1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:09.318808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc895fe2-6996-4427-b43e-22f82f9e1324 admin admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:09.320611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc895fe2-6996-4427-b43e-22f82f9e1324 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:09.322466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc895fe2-6996-4427-b43e-22f82f9e1324 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:09.324097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Mon Apr 11 12:58:09 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:11.671108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12467f-9d9e-44f6-a018-f4bcc2541256 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:11.671617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12467f-9d9e-44f6-a018-f4bcc2541256 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:11.671617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12467f-9d9e-44f6-a018-f4bcc2541256 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:11.672933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:11.678381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:11.678800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:11.678989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:11.695126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:11.696284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:11.707634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1b87-be1a-4c12-9121-016846477cd5 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:11.707923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1b87-be1a-4c12-9121-016846477cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:11.708365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1b87-be1a-4c12-9121-016846477cd5 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:11.709722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:11.714474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:11.714761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:11.715043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:11.755486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG passlib.handlers.bcrypt [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80226) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 12:58:11.755915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG passlib.handlers.bcrypt [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80226) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 12:58:11.774556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:11.800328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:11.803119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:11.804788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:11.896393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9987d-c94e-4f75-8c99-0959ac057296 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:11.899947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:11.922161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:11.930267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:11.931067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:11.931353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:11.931631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:11.942577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:11.949503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:11.951259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:11.957013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:12.018942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041ca17-74ce-429a-8483-9203c42e82ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.049887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146b4fa-d7a1-4657-ac6a-a612127433bd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.053960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.054891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.055183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.055462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.082133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.082804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.083090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.083376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.084127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:12.084435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.085851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.097708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:12.103419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:12.120061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.122210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.196818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b204b59-51e1-4dff-8ea4-55ffb31758ca None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.215311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:12.222442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:12.229712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.230613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.230895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.231403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.232715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.234347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.235995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:12 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:12.241190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:12.317070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa95e-26aa-4edc-8ecf-f6a08d65dc2e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.335453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57c271-a54a-4b0c-8a23-8d08057f7e44 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.349562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.350383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.350665 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.350939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.367439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.368219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.368497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.368769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.369245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.370015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.370759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.371490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.373905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:12.379438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:12.388977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:58:12.390434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:12.395856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:12.475265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0d692-237d-43b5-b152-5fdd74e7123e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.490153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef586-0fba-4128-8712-f27922ace30e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:12.507554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.508209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.508499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.508774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.509610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.domain.id=default, user.id=3c006c2d55954e5a934e999f787f885f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:12.509919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.511377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615411-fc34-41c0-891d-d550fc1ad260 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.518026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Apr 11 12:58:12 2022] GET /identity/v3/role_assignments?user.id=3c006c2d55954e5a934e999f787f885f&scope.domain.id=default&role.id=278a0b419dab4b198abcf738011cdca6 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:12.522590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:12.523301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:12.523589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:12.523870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:12.524630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:12.524941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:12.526409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df4726-1287-4f24-a9fd-ae01c2470d16 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:12.546857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:15.273023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e14332-1b44-44c9-8764-994d00d36206 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.273560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e14332-1b44-44c9-8764-994d00d36206 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.273560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e14332-1b44-44c9-8764-994d00d36206 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.275302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:15.281353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.281780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.281943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.290925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa2ba-97e0-4383-aa6d-b7308768e816 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.291219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa2ba-97e0-4383-aa6d-b7308768e816 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.291504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa2ba-97e0-4383-aa6d-b7308768e816 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.293215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:15.298770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.299064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.299345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.310597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:15.311810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:15.331144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:15.332353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:15.469693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 14/24] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:15.475596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 11/25] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:15.503746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:15.510041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:15.644119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f73e0f-07ce-4d61-8666-040ce20ce031 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:15.664927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe6b9c-a2fc-41fa-aacd-4586a9265191 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:15.705143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:15.706539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.707451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.708188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5da8f4-69ff-4972-9c4d-71945e4b84b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:15.708646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.709602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da8f4-69ff-4972-9c4d-71945e4b84b0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.710625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da8f4-69ff-4972-9c4d-71945e4b84b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.711206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5da8f4-69ff-4972-9c4d-71945e4b84b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.729961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:15.733104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:15.736613 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5da8f4-69ff-4972-9c4d-71945e4b84b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:15.745035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-6d5da8f4-69ff-4972-9c4d-71945e4b84b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:15.759583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 12/26] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:15.760870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e253b5-64a0-4488-ba1d-453d4333ce0b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.761164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e253b5-64a0-4488-ba1d-453d4333ce0b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.761444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e253b5-64a0-4488-ba1d-453d4333ce0b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.764477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-4a372218-9b92-4dc6-a502-2b8c2d419d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:58:15.767046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:15.767973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e253b5-64a0-4488-ba1d-453d4333ce0b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:15.770155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 15/28] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:15.771801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:15.772294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:15.773027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:15.807722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:15.811426 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:15.897809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:15.899330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:16.018812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e253b5-64a0-4488-ba1d-453d4333ce0b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:16.034947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808bd6d-e060-496a-83f0-26fb5c1756c0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:16.072670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:16.073719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.074253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.074802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.076239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:16.076913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:16.079019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:16.098381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 17/30] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:16.099358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:16.099808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:16.100053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.100340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.100619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.101387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:16.101694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:16.103181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:16.132678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 14/31] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:16.133754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:16.210499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397cb82-5d45-4fcb-8bf6-d220e5b0c7da None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:16.247839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:16.248844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.249308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.249755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.250707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:16.252274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:16.294299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de031f-49ae-4166-8e12-dd2d4b055e84 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:16.332793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6af504-f2df-4098-bf2d-2f13bc0f6b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:16.333468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af504-f2df-4098-bf2d-2f13bc0f6b25 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.333753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af504-f2df-4098-bf2d-2f13bc0f6b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.334082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af504-f2df-4098-bf2d-2f13bc0f6b25 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.342292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6af504-f2df-4098-bf2d-2f13bc0f6b25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:16.342292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6af504-f2df-4098-bf2d-2f13bc0f6b25 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:16.526168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 18/32] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Apr 11 12:58:16 2022] POST /identity/v3/roles => generated 219 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:16.526168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:16.632914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b46381-18c6-471f-a41c-e0def3c02f02 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:16.664461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 15/33] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 12:58:16 2022] POST /identity/v3/projects => generated 301 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:16.666375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924f800-641b-4c50-ac0b-e8f969eb99ae None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.666874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924f800-641b-4c50-ac0b-e8f969eb99ae None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.667392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924f800-641b-4c50-ac0b-e8f969eb99ae None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.670025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 16/34] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:16.679542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:16.680618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.680917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.681205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.682043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9679430-b344-4e93-bc06-87319601ac05 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.682651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9679430-b344-4e93-bc06-87319601ac05 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.682864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:16.683331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9679430-b344-4e93-bc06-87319601ac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.685093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:16.690875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 19/35] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:16 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:16.693431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:16.716948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a9679430-b344-4e93-bc06-87319601ac05 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:16.718870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a9679430-b344-4e93-bc06-87319601ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:16.845034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 17/36] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:16.846795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b88bae-6a10-4bae-a227-31539aa64656 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.847379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b88bae-6a10-4bae-a227-31539aa64656 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.847848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b88bae-6a10-4bae-a227-31539aa64656 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.849565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 18/37] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:16.853179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634931c8-ef36-48c6-8c7b-bae94b75f8ac None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.853395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813428f-5970-4c31-ba20-126b04713f42 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:16.853504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634931c8-ef36-48c6-8c7b-bae94b75f8ac None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.853744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634931c8-ef36-48c6-8c7b-bae94b75f8ac None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.855081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 19/38] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:16.859557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.859850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.860135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.889064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:16.890710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:16.904878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913c235-c105-43ef-a0ef-bab505e2b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:16.905776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913c235-c105-43ef-a0ef-bab505e2b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.906060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913c235-c105-43ef-a0ef-bab505e2b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.906397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913c235-c105-43ef-a0ef-bab505e2b2a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.907731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913c235-c105-43ef-a0ef-bab505e2b2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:16.909245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913c235-c105-43ef-a0ef-bab505e2b2a8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:16.911093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 20/39] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:16.912436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:16.912752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:16.913041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:16.935062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:16.936598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:16.979993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 20/40] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:16.980811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:17.011436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:17.012787 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:17.076735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd086-917f-40fb-9650-d4ddc5965bea None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:17.105836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade5a18-bd17-4f8b-997c-676722c12e50 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:17.108663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:17.109342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:17.109626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:17.109905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:17.110707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:17.112215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:17.139108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:17.139985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:17.140270 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:17.140559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] PATH_INFO: `/v3/domains/default/users/3c006c2d55954e5a934e999f787f885f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:17.142604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3c006c2d55954e5a934e999f787f885f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:17.144055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:17.176606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Apr 11 12:58:16 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:17.177550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:17.256783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1361 bytes} [Mon Apr 11 12:58:17 2022] PUT /identity/v3/domains/default/users/3c006c2d55954e5a934e999f787f885f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:17.267989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:17.286551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1d4b4-9fc2-4c10-98d4-d7965f374fe2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:17.325775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:17.326618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:17.326923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:17.327186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:17.328475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:17.329947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:17.331890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 22/44] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:17.337656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:17.443615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59cc25-b4f2-4080-8373-1fea336f1fe6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:17.450845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1659f6-2ef3-4d3d-b80e-4c887ae12ef3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:17.481814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d551c0-0b46-43c2-b16a-ee8b2822c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:17.488416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d551c0-0b46-43c2-b16a-ee8b2822c347 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:17.488416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d551c0-0b46-43c2-b16a-ee8b2822c347 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:17.488416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d551c0-0b46-43c2-b16a-ee8b2822c347 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:17.488416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d551c0-0b46-43c2-b16a-ee8b2822c347 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:17.488917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b4a1f-1c94-4614-8b64-8314ea6be4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:17.488917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4a1f-1c94-4614-8b64-8314ea6be4ef None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:17.489191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d551c0-0b46-43c2-b16a-ee8b2822c347 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:17.489294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4a1f-1c94-4614-8b64-8314ea6be4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:17.489294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4a1f-1c94-4614-8b64-8314ea6be4ef None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:17.489294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4a1f-1c94-4614-8b64-8314ea6be4ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:17.490718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4a1f-1c94-4614-8b64-8314ea6be4ef None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:17.599939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Apr 11 12:58:17 2022] POST /identity/v3/roles => generated 223 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:17.636185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 12:58:17 2022] POST /identity/v3/projects => generated 312 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 12:58:19.614607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f314-f591-48cd-b7b9-7c4d7a24d220 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:19.615162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f314-f591-48cd-b7b9-7c4d7a24d220 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:19.615162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f314-f591-48cd-b7b9-7c4d7a24d220 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:19.616581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 24/47] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:19.622525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:19.622987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:19.623142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:19.639325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:19.640445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:19.704337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:19.729706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f314-f591-48cd-b7b9-7c4d7a24d220 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:19.826090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f314-f591-48cd-b7b9-7c4d7a24d220 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:19.859948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc5d66-7883-4dd6-9910-092e1e562f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:19.860748 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc5d66-7883-4dd6-9910-092e1e562f0a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:19.861030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc5d66-7883-4dd6-9910-092e1e562f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:19.861305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc5d66-7883-4dd6-9910-092e1e562f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:19.871076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc5d66-7883-4dd6-9910-092e1e562f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:19.878095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-6fdc5d66-7883-4dd6-9910-092e1e562f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:19.879324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 25/49] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:19.885075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:19.970899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906467d-8b22-4817-a64c-8c528c7c506d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:19.971216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906467d-8b22-4817-a64c-8c528c7c506d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:19.971397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906467d-8b22-4817-a64c-8c528c7c506d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:19.972794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 26/50] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:19.977783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:19.978074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:19.978387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:19.980757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb784c-e991-42be-a817-7af9f7559f53 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:19.994562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:19.995740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:20.015612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:20.016289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:20.016576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:20.016862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:20.017622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:20.017933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:20.019331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:20.027154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 25/51] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:20.033365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:20.059110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 27/52] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:20.083150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:20.126845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b38ddc-edaa-4713-b6ba-92eb981a96d6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:20.159250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:20.160121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:20.160406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:20.160683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:20.162148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:20.163595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:20.165270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:20 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:20.170648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:20.177272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d4407-8781-413c-a1c7-c1ffe5942ffb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:20.210557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:20.211371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:20.211660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:20.211944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:20.213155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:20.214680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:20.217308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:20.222601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:20.267653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fb7f3-2461-49e1-9d40-70952b72ad8e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:20.299584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:20.300545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:20.300832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:20.301111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:20.302402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:20.303852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:20.305652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:20.312275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:20.315987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348edf8-7df2-431e-8a60-1b4532177459 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:20.349157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52297d49-c667-4b66-ada3-d71ffbd66551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:20.349819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52297d49-c667-4b66-ada3-d71ffbd66551 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:20.350130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52297d49-c667-4b66-ada3-d71ffbd66551 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:20.350418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52297d49-c667-4b66-ada3-d71ffbd66551 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:20.351128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52297d49-c667-4b66-ada3-d71ffbd66551 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:20.352578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52297d49-c667-4b66-ada3-d71ffbd66551 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:20.408222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca573db-b167-4091-a82b-9f09d19f2e30 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:20.429487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 29/56] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Apr 11 12:58:20 2022] POST /identity/v3/projects => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 12:58:20.441547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:20.442271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:20.442564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:20.442850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:20.443763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.domain.id=default, user.id=3c006c2d55954e5a934e999f787f885f) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:20.444081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:20.445612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb9b3-1071-4dc8-b400-cb194c8c3db6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:20.457637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Apr 11 12:58:20 2022] GET /identity/v3/role_assignments?user.id=3c006c2d55954e5a934e999f787f885f&scope.domain.id=default&role.id=278a0b419dab4b198abcf738011cdca6 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:22.744762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c321e38-7a68-45b1-a2fb-d58b7f743f46 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:22.745255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c321e38-7a68-45b1-a2fb-d58b7f743f46 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:22.745255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c321e38-7a68-45b1-a2fb-d58b7f743f46 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:22.747221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 30/58] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:22.752280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:22.752675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:22.752849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:22.769594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:22.770817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:22.832409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 29/59] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:22.858375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c321e38-7a68-45b1-a2fb-d58b7f743f46 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:22.954337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c321e38-7a68-45b1-a2fb-d58b7f743f46 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:22.986370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741f110-df26-42f0-903e-0715e16b8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:22.987149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741f110-df26-42f0-903e-0715e16b8a62 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:22.987437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741f110-df26-42f0-903e-0715e16b8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:22.987717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741f110-df26-42f0-903e-0715e16b8a62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:22.988901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741f110-df26-42f0-903e-0715e16b8a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:22.990404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741f110-df26-42f0-903e-0715e16b8a62 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:22.992044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 31/60] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:22.998132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:23.089944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df173e-1dc5-4dc0-94e7-6a0ee221bb67 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:23.122860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170482ff-9733-432e-9387-4ec49b2bd3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:23.123526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170482ff-9733-432e-9387-4ec49b2bd3be None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:23.123813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170482ff-9733-432e-9387-4ec49b2bd3be None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:23.124088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170482ff-9733-432e-9387-4ec49b2bd3be None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:23.124803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170482ff-9733-432e-9387-4ec49b2bd3be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:23.126289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170482ff-9733-432e-9387-4ec49b2bd3be None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:23.216099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 30/61] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:22 2022] POST /identity/v3/users => generated 275 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:26.640386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838cdc-818b-4d17-921c-46f27a115288 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:26.641407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838cdc-818b-4d17-921c-46f27a115288 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:26.642077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838cdc-818b-4d17-921c-46f27a115288 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:26.643840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 32/62] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:26.650047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47268250-015c-4713-8348-4d0061e10077 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:26.651051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47268250-015c-4713-8348-4d0061e10077 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:26.651555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47268250-015c-4713-8348-4d0061e10077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:26.676542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-47268250-015c-4713-8348-4d0061e10077 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:26.678162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-47268250-015c-4713-8348-4d0061e10077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:26.758060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 31/63] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:26.782961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838cdc-818b-4d17-921c-46f27a115288 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:26.891770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838cdc-818b-4d17-921c-46f27a115288 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:26.927450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838b70e-1ab0-41c6-b6df-3aa4de59d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:26.928606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838b70e-1ab0-41c6-b6df-3aa4de59d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:26.929092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838b70e-1ab0-41c6-b6df-3aa4de59d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:26.929570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838b70e-1ab0-41c6-b6df-3aa4de59d5e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:26.941158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838b70e-1ab0-41c6-b6df-3aa4de59d5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:26.948839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8838b70e-1ab0-41c6-b6df-3aa4de59d5e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:26.950364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 33/64] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:26.956318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47268250-015c-4713-8348-4d0061e10077 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.058707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47268250-015c-4713-8348-4d0061e10077 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.094569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.095620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.096118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.096595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.097635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:27.098164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:27.100515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcb27d-8530-4922-8b01-39c44c42914a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.101163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcb27d-8530-4922-8b01-39c44c42914a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.101665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcb27d-8530-4922-8b01-39c44c42914a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.103305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 34/65] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:27.104661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c7688-056a-4ec9-bcb1-1364bdfc9b31 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:27.109095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e402-059f-401f-9271-827afafda8c5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.109385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e402-059f-401f-9271-827afafda8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.110311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7e402-059f-401f-9271-827afafda8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.116519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 32/66] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:27.118011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6cfaa-524a-4241-9a67-fbc6bf91c2fa None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.118151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6cfaa-524a-4241-9a67-fbc6bf91c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.118422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6cfaa-524a-4241-9a67-fbc6bf91c2fa None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.124341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 33/67] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:27.125324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6cfaa-524a-4241-9a67-fbc6bf91c2fa None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.136701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-68f7e402-059f-401f-9271-827afafda8c5 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:27.139385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-68f7e402-059f-401f-9271-827afafda8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:27.216910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 35/68] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:27.218227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87131-6221-40a9-885c-ae636922d00e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.218521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87131-6221-40a9-885c-ae636922d00e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.218804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87131-6221-40a9-885c-ae636922d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.235320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-35c87131-6221-40a9-885c-ae636922d00e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:27.236515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-35c87131-6221-40a9-885c-ae636922d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:27.242097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6cfaa-524a-4241-9a67-fbc6bf91c2fa None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.279322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d76943-23ab-4667-b0c6-815da5b9a660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.280513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d76943-23ab-4667-b0c6-815da5b9a660 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.280802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d76943-23ab-4667-b0c6-815da5b9a660 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.281089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d76943-23ab-4667-b0c6-815da5b9a660 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.298639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d76943-23ab-4667-b0c6-815da5b9a660 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:27.300103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d76943-23ab-4667-b0c6-815da5b9a660 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:27.301974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:27.303250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d732a3-1bee-416f-816d-44a95e8d6d09 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.303541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d732a3-1bee-416f-816d-44a95e8d6d09 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.303820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d732a3-1bee-416f-816d-44a95e8d6d09 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.309761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 35/70] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:27.309761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d732a3-1bee-416f-816d-44a95e8d6d09 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.312168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 36/71] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:27.317979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87131-6221-40a9-885c-ae636922d00e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.408031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d732a3-1bee-416f-816d-44a95e8d6d09 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.415284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87131-6221-40a9-885c-ae636922d00e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.440172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7936355-f8c5-48d3-9c49-5e34f1e6d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.440964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7936355-f8c5-48d3-9c49-5e34f1e6d2ea None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.441240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7936355-f8c5-48d3-9c49-5e34f1e6d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.441522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7936355-f8c5-48d3-9c49-5e34f1e6d2ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.447866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.448522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.448807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.449087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.451916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7936355-f8c5-48d3-9c49-5e34f1e6d2ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:27.458994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b7936355-f8c5-48d3-9c49-5e34f1e6d2ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:27.460196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 36/72] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:27.461366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c97f7-f1f0-4df5-9cd2-521bdc292ee8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.461648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c97f7-f1f0-4df5-9cd2-521bdc292ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.461930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c97f7-f1f0-4df5-9cd2-521bdc292ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.478511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-840c97f7-f1f0-4df5-9cd2-521bdc292ee8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:27.479630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-840c97f7-f1f0-4df5-9cd2-521bdc292ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:27.516611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:27.518096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:27.541719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 37/73] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:27.543125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a969-a5e9-47e1-9bb8-8d23ca77bee7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.543943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a969-a5e9-47e1-9bb8-8d23ca77bee7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.544222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a969-a5e9-47e1-9bb8-8d23ca77bee7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.545498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 38/74] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:27.546877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545a969-a5e9-47e1-9bb8-8d23ca77bee7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.617452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 37/75] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:27.617452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.644874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545a969-a5e9-47e1-9bb8-8d23ca77bee7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.676556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc07c67-f5a3-4574-9bee-02257c876deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.677361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc07c67-f5a3-4574-9bee-02257c876deb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.677649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc07c67-f5a3-4574-9bee-02257c876deb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.677925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc07c67-f5a3-4574-9bee-02257c876deb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.688259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc07c67-f5a3-4574-9bee-02257c876deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:27.695656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-7fc07c67-f5a3-4574-9bee-02257c876deb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:58:27.696867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:27.698017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.698328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.698609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.706281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976bceb-a793-4f1a-a76f-cd35edfe239a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.714175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:27.715338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:27.739712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.740313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.740597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.740871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.741608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:27.741912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:27.743312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:27.752050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 38/77] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:27.752833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.779322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 40/78] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:27.780175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.849269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825bc1-f61c-4ca4-bcac-0f808b44e1a2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.873140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac447d1-00d3-420f-8ddf-010eb71a56ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:27.880668 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.881455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.881741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.882016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.891860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:27.898764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:27.900112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 39/79] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:27.900719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.907267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:27.908142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:27.908425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:27.908715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:27.909914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:27.911386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:27.913081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 41/80] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:27.913834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:27.996859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f90990-c017-43e5-a87a-5cda15678a83 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.006358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3368ae-1419-43a6-bd4f-e4e5ed611b04 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.028250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.028917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.029206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.029482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.030273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:28.030585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.031960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.039338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.039884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 40/81] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.040216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.040499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.040688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.040774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.041959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.044019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.046058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 42/82] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:27 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.046844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.139502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546cbb-a9d5-4e32-87d2-55f7973c75b3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.139964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6745b-7432-47c8-89a5-d00bd39015d4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.171835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.172027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.172621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.172720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.172903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.173008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.173180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.173271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.173939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:28.174281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.174489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.175647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.175948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.177612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 41/83] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.178415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.188421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 43/84] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.188421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.271817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e903c-9b18-4673-b202-b22d9ec56b88 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.279500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9ff62-b8c5-4a66-b083-ce99b375e22e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.303465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.304111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.304391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.304675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.305493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=8177e42a8d794e678748d23f4f8acf32) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:28.305879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.307341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.311518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.312392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.312638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 42/85] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/role_assignments?user.id=8177e42a8d794e678748d23f4f8acf32&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=7f61ee9da37149509268e80d31dea384 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.314273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.314273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.314425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.314497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.315676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.317606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 44/86] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.318632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.422739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222c1ac-0b3d-406c-83cd-5b7e05c88327 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.430229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca604-0d38-40d0-b925-27934535e7b3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.457297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.457999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.458317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.458601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.466670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.467362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.467648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.467924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.469266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.471266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.528398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.530182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.536929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 45/87] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:28 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:28.546270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.642248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 43/88] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:28.643134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.646775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d6f6-d9df-4fd3-b387-1f87964c481f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.683530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.684623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.685064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.685350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.690134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.690302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.692362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 46/89] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.693243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.752612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950ebc-94ec-4133-85fc-375436d2d037 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.786703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.787273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.787554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.787876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.796730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ea9bb-2380-4759-abfb-452f94cd6548 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.830924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.831798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.832083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.832360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:28.833576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.835072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.837191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 47/90] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:28.837984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:28.866298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:28.868333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:28.948772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7f41a-494f-48b5-b3ec-0336ba434b40 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:28.993524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:28.994529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:28.994822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:28.995111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:29.001182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 44/91] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:29.002323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:29.107325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:29.109286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:29.162969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d78197-e8fc-43c1-8c6c-29fa64cfe339 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:29.227907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:29.228964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:29.229470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:29.234071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:29.235196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=3c006c2d55954e5a934e999f787f885f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:29.235717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:29.237384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:29.248074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:29 2022] GET /identity/v3/role_assignments?user.id=3c006c2d55954e5a934e999f787f885f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:29.249162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:29.294362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 48/93] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:29.297010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:29.467167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced2627-a2ed-4aa8-9e92-edf89c43c212 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:29.511951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948ea6-9898-4dbe-b5ad-efb0b48e763e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:29.539191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:29.540068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:29.540350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:29.540624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:29.543846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:29.545342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:29.547391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 46/94] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:29 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:29.553132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:29.572203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:29.576265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:29.577898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:29.579032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] PATH_INFO: `/v3/projects/d15156327ac04e25961af62ea26c2aff` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:29.582234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] RBAC: Authorizing `identity:get_project(project_id=d15156327ac04e25961af62ea26c2aff)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:29.584671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:29.589521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 49/95] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:29 2022] GET /identity/v3/projects/d15156327ac04e25961af62ea26c2aff => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:29.606439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:29.703131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b62b-bdcd-47c1-9789-92772672ed09 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:29.735387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be93fdf-246b-4b11-bf10-ced96041260e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:29.738329 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:29.739176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:29.739627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:29.740059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:29.741041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] RBAC: Adding query filter params (role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=8177e42a8d794e678748d23f4f8acf32) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:29.741507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:29.743114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95876a-4b29-4a60-ab9c-fb35dc44b185 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:29.749395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 47/96] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:29 2022] GET /identity/v3/role_assignments?user.id=8177e42a8d794e678748d23f4f8acf32&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=b51956c831c84838aece85c3cb553f84 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:29.771216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:29.771887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:29.772169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:29.772445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:29.773291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=d15156327ac04e25961af62ea26c2aff, user.id=8177e42a8d794e678748d23f4f8acf32) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:29.773601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:29.775061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c040406-a012-4f20-99d1-e1c3122705ae None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:29.781193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 50/97] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:29 2022] GET /identity/v3/role_assignments?user.id=8177e42a8d794e678748d23f4f8acf32&scope.project.id=d15156327ac04e25961af62ea26c2aff&role.id=7f61ee9da37149509268e80d31dea384 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:30.934528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd969517-d12c-4489-afbb-1cb6c7d22089 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:30.935380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd969517-d12c-4489-afbb-1cb6c7d22089 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:30.935828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd969517-d12c-4489-afbb-1cb6c7d22089 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:30.937369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 48/98] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:30.942922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ec10-c704-4832-9e94-12d67032504a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:30.943721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ec10-c704-4832-9e94-12d67032504a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:30.944143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ec10-c704-4832-9e94-12d67032504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:30.965249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e727ec10-c704-4832-9e94-12d67032504a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:30.966686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e727ec10-c704-4832-9e94-12d67032504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:31.044358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 51/99] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:31.080114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd969517-d12c-4489-afbb-1cb6c7d22089 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:31.204240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd969517-d12c-4489-afbb-1cb6c7d22089 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:31.248142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:31.253897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.253897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.253897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.263195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:31.270378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:31.271851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 49/100] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:31.277702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ec10-c704-4832-9e94-12d67032504a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:31.435870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ec10-c704-4832-9e94-12d67032504a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:31.473963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:31.474601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.474886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.475167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.475928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:31.476237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:31.477630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:31.486746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 52/101] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:31.493799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:31.597719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5dbcd-ff72-4243-b093-1af197dbaeb5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:31.638159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:31.639053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.639330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.639604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.640830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:31.642309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:31.643963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 50/102] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:31 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:31.649582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:31.754140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0614-00a3-4771-b131-02617bcb6f30 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:31.793605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597e696-eb1f-4c86-a074-f9d9a52c9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:31.794508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e696-eb1f-4c86-a074-f9d9a52c9eee None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.794794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e696-eb1f-4c86-a074-f9d9a52c9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.795074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e696-eb1f-4c86-a074-f9d9a52c9eee None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.796299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e696-eb1f-4c86-a074-f9d9a52c9eee None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:31.797760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e696-eb1f-4c86-a074-f9d9a52c9eee None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:31.799641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 53/103] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:31 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:31.805551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:31.847850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035908-6554-4c61-ae34-408f384f1aa1 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.848187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035908-6554-4c61-ae34-408f384f1aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.848666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035908-6554-4c61-ae34-408f384f1aa1 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.850221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 54/104] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:31.859326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.859612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.859895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.891193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:31.892426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:31.926002 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d01c5-1a21-4cce-8c1f-fbe0d8a9c464 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:31.960811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:31.962567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:31.963070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:31.963561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/8177e42a8d794e678748d23f4f8acf32/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:31.966371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7cd677d97e4258b86ab104b3b550c6, user_id=8177e42a8d794e678748d23f4f8acf32, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:31.968061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:31.990872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 55/105] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:32.040700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:32.052111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 51/106] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:31 2022] PUT /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/8177e42a8d794e678748d23f4f8acf32/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:32.157089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d55f-3c42-4b60-8249-a232fc977f25 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:32.194609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:32.195804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.196315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.196779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.209454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:32.217521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:32.219105 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 56/107] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:32.226652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:32.332966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fb5d6-3083-4d48-adef-6dd7f6d3299d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:32.373533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:32.374580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.375058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.375566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.376520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:32.377005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:32.379076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344284-67d3-47d7-b838-20b3ab9af8bb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:32.404527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 52/108] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:32.410390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:32.449193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb6749-f256-4d26-8e19-f132d796f67f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.449841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb6749-f256-4d26-8e19-f132d796f67f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.450473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb6749-f256-4d26-8e19-f132d796f67f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.452388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 53/109] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:32.457369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.457917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.458405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.488031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:32.491098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:32.557584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97081-12de-433f-b83a-3a8a857f2d2c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:32.584551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 54/110] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:32.602018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:32.602939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.603228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.603513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] PATH_INFO: `/v3/users/5fa6d6821b8c45449c831a88698a6c7f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.613445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:32.631173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] RBAC: Authorizing `identity:get_user(user_id=5fa6d6821b8c45449c831a88698a6c7f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:32.632887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:32.637558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 57/111] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:32 2022] GET /identity/v3/users/5fa6d6821b8c45449c831a88698a6c7f => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:32.643169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:32.758023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12ba03-2fec-4524-b4a0-d1cd031f76a7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:32.761440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847914-5279-4391-8c57-9d43c60beded None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:32.798635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:32.800084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.800639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.801114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.803070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:32.804827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:32.806747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 55/112] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:32.812768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:32.847548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08b103-588a-427a-afe8-f65938530c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:32.848099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b103-588a-427a-afe8-f65938530c09 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.848389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b103-588a-427a-afe8-f65938530c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.848927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b103-588a-427a-afe8-f65938530c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.924765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a109af-b3e3-487a-87ff-91440e5e1cdc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:32.963332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:32.965035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:32.966098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:32.966608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:32.967520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:32.969157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:33.007772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08b103-588a-427a-afe8-f65938530c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:33.009318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08b103-588a-427a-afe8-f65938530c09 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:33.105493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 56/113] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 12:58:32 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:33.113251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 58/114] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:33.119313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:33.183753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ffb4b-ee32-435c-bdc8-9ab799fbf8b7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.184143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ffb4b-ee32-435c-bdc8-9ab799fbf8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.184392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ffb4b-ee32-435c-bdc8-9ab799fbf8b7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.185861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 59/115] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:33.191418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2789e-9023-444e-89fa-798b6ab4202d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.191718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2789e-9023-444e-89fa-798b6ab4202d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.192004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2789e-9023-444e-89fa-798b6ab4202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.224456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d0a2789e-9023-444e-89fa-798b6ab4202d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:33.225674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d0a2789e-9023-444e-89fa-798b6ab4202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:33.253517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76766db-393a-440d-a00f-bc8f3bf7e01b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:33.292290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2c61b-34c9-4b71-8cb0-9d8140131c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:33.294197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2c61b-34c9-4b71-8cb0-9d8140131c81 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.294701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2c61b-34c9-4b71-8cb0-9d8140131c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.295188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2c61b-34c9-4b71-8cb0-9d8140131c81 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.296903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2c61b-34c9-4b71-8cb0-9d8140131c81 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:33.298968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2c61b-34c9-4b71-8cb0-9d8140131c81 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:33.305474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 57/116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:33 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:33.305474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456718ee-f891-43d0-b7d1-dd91f45e2b51 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.305474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456718ee-f891-43d0-b7d1-dd91f45e2b51 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.305474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456718ee-f891-43d0-b7d1-dd91f45e2b51 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.305474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 58/117] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:33.311323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456718ee-f891-43d0-b7d1-dd91f45e2b51 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:33.404217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 60/118] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:33.405537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.405839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.406141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.438943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:33.440252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:33.468069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456718ee-f891-43d0-b7d1-dd91f45e2b51 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:33.507948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:33.508856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.509287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.509712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.510726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] RBAC: Adding query filter params (role.id=30bf9be1f3194301a4dbdc699b3931f1, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=5fa6d6821b8c45449c831a88698a6c7f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:33.511128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:33.512881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:33.519676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 59/119] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:33 2022] GET /identity/v3/role_assignments?user.id=5fa6d6821b8c45449c831a88698a6c7f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=30bf9be1f3194301a4dbdc699b3931f1 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:33.519827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:33.537106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 61/120] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:33.579236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:33.666575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9e0f-e0d5-43fb-932e-ee183929ec6e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:33.719498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:33.720681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.721187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.721691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.740639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:33.749832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:33.751350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 60/121] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:33.758100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:33.822946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102fde-98ce-46d2-b3b9-a9bb88fd7a81 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:33.878621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695f978-87f8-4ff1-ba23-6a2280365f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:33.879508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f978-87f8-4ff1-ba23-6a2280365f67 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.879801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f978-87f8-4ff1-ba23-6a2280365f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.880087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f978-87f8-4ff1-ba23-6a2280365f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.894072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ac86c-c337-4eae-b4de-894451f809e2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:33.894903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695f978-87f8-4ff1-ba23-6a2280365f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:33.902049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-3695f978-87f8-4ff1-ba23-6a2280365f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:33.911521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 62/122] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:33.912850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a295-912e-4855-8c0a-d063a4491343 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.913144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a295-912e-4855-8c0a-d063a4491343 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.913432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a295-912e-4855-8c0a-d063a4491343 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.914822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 63/123] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:33.921970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.922220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.922517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.930743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:33.931691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:33.932174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:33.932649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:33.933596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:33.934672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:33.936260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:33.945253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 61/124] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:33.946395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:33.951197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:33.951888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:34.055320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b8e04-7016-4c36-a2ec-3cd4719effe3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.065023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 64/125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:34.065903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.092078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.093125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.093638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.094137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.095103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:34.095606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.097195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.114132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 62/126] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.115365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.175343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d4468-c348-41c7-9caa-4c8c845b7b50 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.221868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.222776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.223060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.223336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.224974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.226456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.228111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 65/127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.228876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.283840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9042bec-0edb-4d3a-9891-ce72242067a5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.358832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.359667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.359962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.360230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.366251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeab0ae-82c8-4e39-b1f3-70f35b0f5c22 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.383191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:34.392781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:58:34.396403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 63/128] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:34.403959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.416891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.418130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.423686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.424203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.425774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.427466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.429369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 66/129] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.432098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.550125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88c254-0d61-4c13-8a97-893b181d3bcc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.587483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.588184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.588474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.588757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.589526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:34.589840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.591860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.600953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 67/130] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.601874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.660925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab341aa-05f8-4885-87fe-08621fee6cc9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.702603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dcddf-fb21-4b5c-aa95-b35a7c48b8c0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.737398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.738298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.738587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.738983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.739369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.740188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.740300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.740532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.740816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] PATH_INFO: `/v3/projects/d15156327ac04e25961af62ea26c2aff` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.741734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.743484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 68/131] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.743968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] RBAC: Authorizing `identity:get_project(project_id=d15156327ac04e25961af62ea26c2aff)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.744259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.745510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.747439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 64/132] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/projects/d15156327ac04e25961af62ea26c2aff => generated 312 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.754085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.845978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f813ee-d0c8-4335-ae3c-cf765c64cbb4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.882998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:34.883891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:34.884178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:34.884459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:34.885807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:34.887305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:34.888971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 69/133] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:34 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:34.889739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:34.989823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7b738-d101-4931-bcf6-dfb6258ab739 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:34.992216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1076a3b-bbd4-4911-815b-9a104c243c52 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:35.034128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.034128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.034128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.034128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/3c006c2d55954e5a934e999f787f885f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.034523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7cd677d97e4258b86ab104b3b550c6, user_id=3c006c2d55954e5a934e999f787f885f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:35.034523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:35.049528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef4d0f-ff2d-4590-b30c-c0bf88484a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.050843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4d0f-ff2d-4590-b30c-c0bf88484a1a None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.054711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4d0f-ff2d-4590-b30c-c0bf88484a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.054711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4d0f-ff2d-4590-b30c-c0bf88484a1a None admin] PATH_INFO: `/v3/projects/d15156327ac04e25961af62ea26c2aff/users/8177e42a8d794e678748d23f4f8acf32/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.054711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef4d0f-ff2d-4590-b30c-c0bf88484a1a None admin] RBAC: Authorizing `identity:create_grant(project_id=d15156327ac04e25961af62ea26c2aff, user_id=8177e42a8d794e678748d23f4f8acf32, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:35.055727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef4d0f-ff2d-4590-b30c-c0bf88484a1a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:35.154160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 70/134] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:34 2022] PUT /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/3c006c2d55954e5a934e999f787f885f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:35.154979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:35.177530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 65/135] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:34 2022] PUT /identity/v3/projects/d15156327ac04e25961af62ea26c2aff/users/8177e42a8d794e678748d23f4f8acf32/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 12:58:35.245278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d3a62-0466-4800-8cff-5213083937bf None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.245553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d3a62-0466-4800-8cff-5213083937bf None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.245810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d3a62-0466-4800-8cff-5213083937bf None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.247805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 66/136] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:35.253285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.253582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.253869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.271755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:35.273046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:35.296135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebc8e-4413-41bd-8fa1-631e06c8d89a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:35.345984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.347769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.348417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.349218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.351482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:35.353598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:35.356904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 71/137] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:35 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:35.361990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 67/138] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:35.362804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:35.389245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:35.539669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fadf2-6af9-4ae1-94dd-123255392492 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:35.553341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3361-e179-432e-95af-8a2cb4f3fc0b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:35.575914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.576993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.577387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.577768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/8177e42a8d794e678748d23f4f8acf32/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.580243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7cd677d97e4258b86ab104b3b550c6, user_id=8177e42a8d794e678748d23f4f8acf32, role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:35.581815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:35.592729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.593765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.594225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.594503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.606191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:35.613412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:35.614711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 68/139] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:35.620826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:35.642227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 72/140] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:35 2022] PUT /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/8177e42a8d794e678748d23f4f8acf32/roles/b51956c831c84838aece85c3cb553f84 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 12:58:35.737743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9d37-a436-46eb-9fb8-58d61ba0575f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:35.778892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.779688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.779972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.780248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.781024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:35.781332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:35.782767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:35.792557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 69/141] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:35.798989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:35.935044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5583840-1f5b-4c82-899a-9da75b975fe5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:35.970620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:35.971888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:35.972401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:35.972880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:35.974589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:35.976293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:35.978545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 73/142] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:35 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:35.991377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:36.122033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca387fe-888a-4fc0-ad49-1f954e33fdce None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:36.163010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:36.163688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.163972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.164251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.237867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:36.239692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:36.340686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 70/143] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:36.346269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:36.449983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c4353-b123-42c2-b5a6-d96f6a24c0f3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:36.485046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79f43c-4245-4bd5-b1e8-ce122842dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:36.485921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79f43c-4245-4bd5-b1e8-ce122842dca2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.486236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79f43c-4245-4bd5-b1e8-ce122842dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.486515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79f43c-4245-4bd5-b1e8-ce122842dca2 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.487732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79f43c-4245-4bd5-b1e8-ce122842dca2 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:36.489172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79f43c-4245-4bd5-b1e8-ce122842dca2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:36.491102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 74/144] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:36 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:36.497055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:36.598317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd184a-6fb2-458c-b7a4-ca4476aad16a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:36.633741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd71bf-11bb-468e-af30-7b80de776d21 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.634036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd71bf-11bb-468e-af30-7b80de776d21 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.634401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd71bf-11bb-468e-af30-7b80de776d21 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.634865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:36.635865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 75/145] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:36.636216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.636762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.637749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.638857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=8177e42a8d794e678748d23f4f8acf32) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:36.639382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:36.641117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52bd31-82b1-4e5e-9384-5ec5db5ee24b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:36.641506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.641804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.642088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.650952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 71/146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:36 2022] GET /identity/v3/role_assignments?user.id=8177e42a8d794e678748d23f4f8acf32&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=7f61ee9da37149509268e80d31dea384 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:36.671179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:36.671911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd109a-645b-48c6-8250-0d45dffb1d2b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.672208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd109a-645b-48c6-8250-0d45dffb1d2b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.672435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:36.672535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd109a-645b-48c6-8250-0d45dffb1d2b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.674134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 72/147] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:36.692638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:36.692932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:36.693206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:36.731658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:36.732849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:36.815601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 76/148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:36.832679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 73/149] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:36.850969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:36.883903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:36.988077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fff24-3109-4e26-9c99-f664cd7ba7ad None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.024521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.025395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.025680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.026008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.038441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:37.046564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:37.048150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 77/150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:37.053830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:37.061820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcaad6-628e-4bfe-870b-d4b9f87d45af None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.127734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.129299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.129786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.130306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.131714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:37.138130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:37.140136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 74/151] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:37.145802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:37.155586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e220-4c37-4b2a-b9c1-0b7776eeae93 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.198137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.198137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.198137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.198137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.198526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:37.198526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:37.198526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:37.205381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 78/152] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:37.212252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:37.317252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffdf62-d508-49f3-824e-864af8bab8aa None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.352271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.353175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.353458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.353750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] PATH_INFO: `/v3/users/5fa6d6821b8c45449c831a88698a6c7f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.356980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=5fa6d6821b8c45449c831a88698a6c7f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:37.358579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:37.361602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 79/153] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:37 2022] GET /identity/v3/users/5fa6d6821b8c45449c831a88698a6c7f => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:37.369259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:37.377880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1237e5-b4a1-4a49-848e-970b0e9c9142 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.452005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ce21a-677b-4567-881a-baae84b6ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.452691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ce21a-677b-4567-881a-baae84b6ef50 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.453016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ce21a-677b-4567-881a-baae84b6ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.453298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ce21a-677b-4567-881a-baae84b6ef50 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.454019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ce21a-677b-4567-881a-baae84b6ef50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:37.455502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ce21a-677b-4567-881a-baae84b6ef50 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:37.536024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2450a-2a2e-458b-b623-4cf2fd170bb7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.571625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.572414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.572691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.572963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.574242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:37.576029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:37.579671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 80/154] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:37 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:37.589657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 75/155] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:37 2022] POST /identity/v3/users => generated 283 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 12:58:37.590803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:37.704283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c641-b878-478e-83aa-16a8c31070a5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:37.743489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc4d7d-21cc-430f-bb78-1661b5954363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:37.744411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc4d7d-21cc-430f-bb78-1661b5954363 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:37.744690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc4d7d-21cc-430f-bb78-1661b5954363 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:37.744963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc4d7d-21cc-430f-bb78-1661b5954363 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/5fa6d6821b8c45449c831a88698a6c7f/roles/30bf9be1f3194301a4dbdc699b3931f1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:37.747452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc4d7d-21cc-430f-bb78-1661b5954363 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7cd677d97e4258b86ab104b3b550c6, user_id=5fa6d6821b8c45449c831a88698a6c7f, role_id=30bf9be1f3194301a4dbdc699b3931f1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:37.748967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc4d7d-21cc-430f-bb78-1661b5954363 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:37.811104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 81/156] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:37 2022] PUT /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/users/5fa6d6821b8c45449c831a88698a6c7f/roles/30bf9be1f3194301a4dbdc699b3931f1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:38.347464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e9b8-e52a-4672-b2e5-712550e0a95a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:38.347964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e9b8-e52a-4672-b2e5-712550e0a95a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:38.348036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e9b8-e52a-4672-b2e5-712550e0a95a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:38.350030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 76/157] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:38.355672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:38.356787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:38.356787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:38.376354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:38.377550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:38.463788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 82/158] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:38.509778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3e9b8-e52a-4672-b2e5-712550e0a95a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:38.630428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3e9b8-e52a-4672-b2e5-712550e0a95a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:38.673283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01e27-db63-49df-baa6-3e5905a47a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:38.674146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01e27-db63-49df-baa6-3e5905a47a8e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:38.674433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01e27-db63-49df-baa6-3e5905a47a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:38.674710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01e27-db63-49df-baa6-3e5905a47a8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:38.691232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f01e27-db63-49df-baa6-3e5905a47a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:38.698462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f0f01e27-db63-49df-baa6-3e5905a47a8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:38.700326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 77/159] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:38.707560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:38.756621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783169-5dc0-4bde-af02-b8dfffca9cc1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:38.756925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783169-5dc0-4bde-af02-b8dfffca9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:38.757191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783169-5dc0-4bde-af02-b8dfffca9cc1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:38.758646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 78/160] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:38.764649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:38.764930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:38.765207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:38.785436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:38.786662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:38.831553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af7839-b326-4786-bd39-29b5d47ba7fe None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:38.865821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 79/161] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:38.872099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:38.872776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:38.873125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:38.873405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:38.874186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:38.874498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:38.876023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:38.884751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 83/162] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:38.891111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:38.910142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.008158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaa0eb-ca6a-4e46-a1a9-a72004f5028d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.028885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35436-8bd0-4d27-ab08-b376bf071c5a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.050275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.051597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.051886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.052164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] PATH_INFO: `/v3/users/3c006c2d55954e5a934e999f787f885f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.053653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] RBAC: Authorizing `identity:get_user(user_id=3c006c2d55954e5a934e999f787f885f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:39.056694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:39.057335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 80/163] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:38 2022] GET /identity/v3/users/3c006c2d55954e5a934e999f787f885f => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:39.063572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.069451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.070564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.071048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.071545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.082791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:39.090929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:39.092550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 84/164] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:39.100469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.178215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe68a3c-4938-4ad3-ba6c-7a808b1413bf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.208913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.209571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.209853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.210146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.245649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f5f7-03c9-4799-80ec-1130a4b80dd7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.286140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:39.286140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:39.298388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.299430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.299940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.300415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.306138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:39.306803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:39.308451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:39.317624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 85/165] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:39.341115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.399244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 81/166] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:39.405433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.505117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b79de-ddb6-4f99-adc8-c97699bd8f51 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.548267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6212b0-0160-4c11-99c2-a24ad9682be4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.554393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20943cd-718b-432a-aed4-a0d765157419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.555286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20943cd-718b-432a-aed4-a0d765157419 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.555572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20943cd-718b-432a-aed4-a0d765157419 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.555851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20943cd-718b-432a-aed4-a0d765157419 None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.557085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20943cd-718b-432a-aed4-a0d765157419 None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:39.558566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20943cd-718b-432a-aed4-a0d765157419 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:39.560840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 86/167] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:39.562060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197d96c-0405-4391-8181-0561de07977d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.562372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197d96c-0405-4391-8181-0561de07977d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.562651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197d96c-0405-4391-8181-0561de07977d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.564043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 87/168] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:39.571066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197d96c-0405-4391-8181-0561de07977d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.638806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c930a5-fe5c-421f-8019-2a07f1ff4e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.639942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c930a5-fe5c-421f-8019-2a07f1ff4e21 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.640382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c930a5-fe5c-421f-8019-2a07f1ff4e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.640797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c930a5-fe5c-421f-8019-2a07f1ff4e21 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.642227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c930a5-fe5c-421f-8019-2a07f1ff4e21 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:39.643820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c930a5-fe5c-421f-8019-2a07f1ff4e21 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:39.645998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 82/169] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:39.647350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.647811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.648257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.679529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197d96c-0405-4391-8181-0561de07977d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:39.687330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:39.688854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:39.714514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:39.715997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:39.716427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:39.716864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:39.785370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:39.787077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:39.848988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 83/170] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:39.850004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.890608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 88/171] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:39.891705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:39.994355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257690c-851b-496b-8b88-d9a618bf3ff0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.031920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.032972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.033429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.033865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.044928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:40.052557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:58:40.053950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 89/172] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:40.054924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:40.073917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdc5e1-30d0-4c4b-8fcc-92346d17aada None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.153048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.154059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.154560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.155053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.156195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=3c006c2d55954e5a934e999f787f885f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:40.156718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:40.158374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:40.158855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697aed-5ccc-4f64-b85c-42ce2fd38ca3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.176390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 84/173] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:39 2022] GET /identity/v3/role_assignments?user.id=3c006c2d55954e5a934e999f787f885f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:40.177442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:40.195212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.196356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.196810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.197230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] PATH_INFO: `/v3/projects/d15156327ac04e25961af62ea26c2aff` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.198655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] RBAC: Authorizing `identity:get_project(project_id=d15156327ac04e25961af62ea26c2aff)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:40.200315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:40.202306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 90/174] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:40 2022] GET /identity/v3/projects/d15156327ac04e25961af62ea26c2aff => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:40.211471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:40.333502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ae4a-0009-41c4-8557-b1a9e64fb839 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.392838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a389a1-c6ba-4bb2-9b92-35f12bfb50c9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.400631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.401775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.402299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.403326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.404679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=d15156327ac04e25961af62ea26c2aff, user.id=8177e42a8d794e678748d23f4f8acf32) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:40.405207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:40.411337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:40.418076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 91/175] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:40 2022] GET /identity/v3/role_assignments?user.id=8177e42a8d794e678748d23f4f8acf32&scope.project.id=d15156327ac04e25961af62ea26c2aff&role.id=7f61ee9da37149509268e80d31dea384 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:40.444000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.444700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.445146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.445583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.446547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:40.447005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:40.448581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:40.462638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 85/176] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:58:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:40.468457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:40.620042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3dd3d-9484-4054-a68e-5028c63b4bfe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.657157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.658061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.658371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.658654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] PATH_INFO: `/v3/users/8177e42a8d794e678748d23f4f8acf32` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.659921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] RBAC: Authorizing `identity:get_user(user_id=8177e42a8d794e678748d23f4f8acf32)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:40.661375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:40.663111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 92/177] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:40 2022] GET /identity/v3/users/8177e42a8d794e678748d23f4f8acf32 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:40.668863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:40.797601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604fa89-761f-49bb-a790-784ef167e249 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:40.837416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:40.838417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:40.838877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:40.839328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:40.913388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:40.915164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:41.035383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:41.041271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:41.148342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9141f6-1ab2-42c3-8c23-5674193b7b6f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:41.187284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8f2c6-1913-48e9-8f49-927251703564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:41.188511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8f2c6-1913-48e9-8f49-927251703564 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.189049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8f2c6-1913-48e9-8f49-927251703564 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.189510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8f2c6-1913-48e9-8f49-927251703564 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.191194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8f2c6-1913-48e9-8f49-927251703564 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:41.192859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8f2c6-1913-48e9-8f49-927251703564 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:41.195150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 93/179] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:41 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:41.201246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:41.321839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5468dd-fccb-4b62-b1f5-c8cd7bc63bcf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:41.360604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:41.361604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.362152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.362604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.364229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] RBAC: Adding query filter params (role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=8177e42a8d794e678748d23f4f8acf32) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:41.365073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:41.367151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02549d6-ffca-4937-8981-502c649b5ed0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:41.374413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 87/180] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:41 2022] GET /identity/v3/role_assignments?user.id=8177e42a8d794e678748d23f4f8acf32&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=b51956c831c84838aece85c3cb553f84 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:41.573202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216f506-c292-46a9-9485-f9d37bcc26d0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.573895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216f506-c292-46a9-9485-f9d37bcc26d0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.574489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216f506-c292-46a9-9485-f9d37bcc26d0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.576746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 94/181] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:41.582718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21793bc-3b75-49d2-9509-7dbad495eaa7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.583649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21793bc-3b75-49d2-9509-7dbad495eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.584128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21793bc-3b75-49d2-9509-7dbad495eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.607798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a21793bc-3b75-49d2-9509-7dbad495eaa7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:41.609364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a21793bc-3b75-49d2-9509-7dbad495eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:41.693127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 88/182] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:41.719637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216f506-c292-46a9-9485-f9d37bcc26d0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:41.730468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2b98-26fc-4002-92dc-c980b8c697e8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.731213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2b98-26fc-4002-92dc-c980b8c697e8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.731681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2b98-26fc-4002-92dc-c980b8c697e8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.733273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 89/183] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:41.738731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.739246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.739731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.762950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:41.764684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:41.835155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 90/184] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:41.849200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216f506-c292-46a9-9485-f9d37bcc26d0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:41.861027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:41.886646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:41.887509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:41.887869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:41.888164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:41.901161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:41.908676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:41.909939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 95/185] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:41.915574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:41.968094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33e64-ebc8-42d6-9222-72482922da0a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.005612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.006821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.007319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.007805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.019764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:42.021318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea12ec-fc98-414e-8e25-5861c2b681d5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.027721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:42.029368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 91/186] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:42.035478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.059452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.060125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.060563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.060988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.061889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:42.062370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.063913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.072402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 96/187] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:42.078190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.140050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5f5b-c94f-47b6-ac2b-8dd85bca7943 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.174436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.175543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.176054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.176594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.177548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:42.178058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.179693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.180446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19867cd2-cc82-46bb-93c3-542df5805aa4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.193884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 92/188] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:42.195078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.215912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.216792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.217077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.217354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] PATH_INFO: `/v3/users/93cd3a396460418c82f2c438bb3ff746` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.231332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] RBAC: Authorizing `identity:get_user(user_id=93cd3a396460418c82f2c438bb3ff746)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.233061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.235064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 97/189] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/users/93cd3a396460418c82f2c438bb3ff746 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:42.240733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.300121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f439-c794-4a66-8b4a-b1ce899e4c06 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.335176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.336434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.336915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.337382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] PATH_INFO: `/v3/users/5fa6d6821b8c45449c831a88698a6c7f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.338798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] RBAC: Authorizing `identity:get_user(user_id=5fa6d6821b8c45449c831a88698a6c7f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.341033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.342354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a732412-3385-4217-bee8-3bdbb12fecb5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.343052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 93/190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/users/5fa6d6821b8c45449c831a88698a6c7f => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:42.348476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.377866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d2b1c-27cb-42d2-8217-ef16114d49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.378552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2b1c-27cb-42d2-8217-ef16114d49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.378833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2b1c-27cb-42d2-8217-ef16114d49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.379106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d2b1c-27cb-42d2-8217-ef16114d49a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.450192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d2b1c-27cb-42d2-8217-ef16114d49a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.451554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d2b1c-27cb-42d2-8217-ef16114d49a0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.452358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da892098-2412-4782-9f31-90660f4b3606 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.484306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdc2a9-5439-4a13-aeee-fe80b818a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.484954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdc2a9-5439-4a13-aeee-fe80b818a84a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.485241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdc2a9-5439-4a13-aeee-fe80b818a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.485521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdc2a9-5439-4a13-aeee-fe80b818a84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.542983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 98/191] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:42.542983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfd8a6-3bb6-4aab-9bd4-2240eafc9d60 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.542983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfd8a6-3bb6-4aab-9bd4-2240eafc9d60 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.542983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfd8a6-3bb6-4aab-9bd4-2240eafc9d60 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.542983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 99/192] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:42.549235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdc2a9-5439-4a13-aeee-fe80b818a84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.550749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdc2a9-5439-4a13-aeee-fe80b818a84a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.551412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d493b58-b7d9-4d54-99fe-83c86384552e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.551702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d493b58-b7d9-4d54-99fe-83c86384552e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.551981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d493b58-b7d9-4d54-99fe-83c86384552e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.553293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 100/193] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:42.554242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d493b58-b7d9-4d54-99fe-83c86384552e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.646414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 94/194] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:42.649541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d493b58-b7d9-4d54-99fe-83c86384552e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.651653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.652009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.652298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.668536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:42.669706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:42.682426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36ab1-4a13-475d-ad92-5f27454e68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.683284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36ab1-4a13-475d-ad92-5f27454e68a6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.683563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36ab1-4a13-475d-ad92-5f27454e68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.683912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36ab1-4a13-475d-ad92-5f27454e68a6 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.685115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36ab1-4a13-475d-ad92-5f27454e68a6 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.686581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36ab1-4a13-475d-ad92-5f27454e68a6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.688293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 101/195] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:42.689423 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.689709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.689983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.706931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:42.708035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:42.737010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 95/196] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:42.737843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.772565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 102/197] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:42.773412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.834227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc382c-d533-4fef-aedd-0258ca588eff None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.865747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.866629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.866792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf4a8f-98a0-4617-a64d-fdd31f3a4def None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:42.866894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.867167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.868333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.869762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.876820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 96/198] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:42.876820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.901149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:42.901804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:42.902087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:42.902502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:42.903338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=93cd3a396460418c82f2c438bb3ff746) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:42.903644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:42.905069 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:42.910222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 103/199] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/role_assignments?user.id=93cd3a396460418c82f2c438bb3ff746&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:42.911067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:42.975867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30bc86-1d78-45ef-99b3-bb94f1160e24 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.014281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3451e-4a05-4979-a706-987c3d0a62cd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.014684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.015557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.016026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.016304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.030753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:43.038507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:58:43.045107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 97/200] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:43.045107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:43.056507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.057317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.057611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.057871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.059724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.061208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.062985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 104/201] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:43.068414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:43.148388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c7d09-5d59-4014-9270-db487bdbd33b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.167612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0e063-0dc2-48aa-b4b9-600ecbe97806 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.185606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.186295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.186578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.186849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.187744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] RBAC: Adding query filter params (role.id=30bf9be1f3194301a4dbdc699b3931f1, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6, user.id=5fa6d6821b8c45449c831a88698a6c7f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:43.187981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.189425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.195351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 98/202] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:43 2022] GET /identity/v3/role_assignments?user.id=5fa6d6821b8c45449c831a88698a6c7f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=30bf9be1f3194301a4dbdc699b3931f1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:43.196111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:43.201702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.206767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.206767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.206767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.206767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:43.206767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.206767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.226402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 105/203] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:43.228855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:43.330785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1984890-3c20-406b-aefa-8cbde9ba5697 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.365426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596c6a-399d-4c5d-a094-86270b771135 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.374787 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.376971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.378141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.378497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.379243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.381370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.414654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.415575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.415812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.416084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] PATH_INFO: `/v3/users/93cd3a396460418c82f2c438bb3ff746` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.417294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] RBAC: Authorizing `identity:get_user(user_id=93cd3a396460418c82f2c438bb3ff746)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.418782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.420616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 106/204] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:43 2022] GET /identity/v3/users/93cd3a396460418c82f2c438bb3ff746 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:43.426905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:43.490893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 99/205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:43 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:43.535390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77497b22-003c-4476-b620-cc610e3031dd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.572317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.573359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.573847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.574396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.649169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.651033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.756760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 107/206] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:43.763013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:43.885531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523a23-e452-4a27-b5db-d5af5d21f88f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:43.929290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88a338-16a3-40ad-85a8-af7756af1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:43.930191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88a338-16a3-40ad-85a8-af7756af1f59 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:43.930477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88a338-16a3-40ad-85a8-af7756af1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:43.930751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88a338-16a3-40ad-85a8-af7756af1f59 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:43.932719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88a338-16a3-40ad-85a8-af7756af1f59 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:43.934292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88a338-16a3-40ad-85a8-af7756af1f59 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:43.936045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 100/207] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:43 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:43.941961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:44.098172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffd813-5930-457d-9fdc-af47b5e45186 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:44.133062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:44.133729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:44.134010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:44.134321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:44.135158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] RBAC: Adding query filter params (role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=93cd3a396460418c82f2c438bb3ff746) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:44.135468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:44.137435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd8a3-74a0-4edb-9c20-9043819d742d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:44.143320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 108/208] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:43 2022] GET /identity/v3/role_assignments?user.id=93cd3a396460418c82f2c438bb3ff746&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=b51956c831c84838aece85c3cb553f84 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:45.282326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455001c-e844-4fad-844b-427ab63c69e7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:45.282326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455001c-e844-4fad-844b-427ab63c69e7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:45.282326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455001c-e844-4fad-844b-427ab63c69e7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:45.283451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 101/209] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:45.290927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:45.290927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:45.290927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:45.307116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:45.308581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:45.382212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 109/210] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:45.400386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455001c-e844-4fad-844b-427ab63c69e7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:45.504033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455001c-e844-4fad-844b-427ab63c69e7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:45.537501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:45.538642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:45.539114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:45.539574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:45.550566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:45.557713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:45.564860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 102/211] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:45.566503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:45.665081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599212-1e2c-4d1a-a916-8e2224910af2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:45.700555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:45.701644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:45.702155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:45.702632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:45.703619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:45.704157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:45.705775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:45.722342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 110/212] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:45.725367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:45.828824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b284f-4d9f-4960-b1a6-b9c9a316daa5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:45.862370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:45.863584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:45.864057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:45.864518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] PATH_INFO: `/v3/users/93cd3a396460418c82f2c438bb3ff746` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:45.865921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] RBAC: Authorizing `identity:get_user(user_id=93cd3a396460418c82f2c438bb3ff746)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:45.867595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:45.869434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 103/213] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:45 2022] GET /identity/v3/users/93cd3a396460418c82f2c438bb3ff746 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:45.875873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:45.975739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002183-315c-4427-a2f7-62cea480e2c7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.009702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d028e90-e3d5-4344-9e89-53e21d7c16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.010968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d028e90-e3d5-4344-9e89-53e21d7c16a6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.011442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d028e90-e3d5-4344-9e89-53e21d7c16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.012800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d028e90-e3d5-4344-9e89-53e21d7c16a6 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.014242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d028e90-e3d5-4344-9e89-53e21d7c16a6 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:46.015897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d028e90-e3d5-4344-9e89-53e21d7c16a6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:46.022202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 111/214] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:45 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:46.024021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.095722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe09f9-c9da-4191-8f8f-613f7c3b8ef6 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.096341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe09f9-c9da-4191-8f8f-613f7c3b8ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.096840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe09f9-c9da-4191-8f8f-613f7c3b8ef6 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.099097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 112/215] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:46.102007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c17d0-c207-410f-8510-69d4dcda1ed3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.102334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c17d0-c207-410f-8510-69d4dcda1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.102836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c17d0-c207-410f-8510-69d4dcda1ed3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.104545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 113/216] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:46.105999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820d44-e9bc-44f4-a6ed-62091a0a7272 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.110494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820d44-e9bc-44f4-a6ed-62091a0a7272 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.110842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820d44-e9bc-44f4-a6ed-62091a0a7272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.128987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f4820d44-e9bc-44f4-a6ed-62091a0a7272 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:46.130166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4820d44-e9bc-44f4-a6ed-62091a0a7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:46.131358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544938ea-fdde-453a-acdc-eaf187f52082 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.170302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.171203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.171482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.172123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/93cd3a396460418c82f2c438bb3ff746/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.174709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=996e7dd26aac4b0185bc47055a3a2d9d, user_id=93cd3a396460418c82f2c438bb3ff746, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:46.176181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:46.195343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 114/217] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:46.196695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.196985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.197259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.215033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:46.216194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:46.244549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 104/218] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:46 2022] PUT /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/93cd3a396460418c82f2c438bb3ff746/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:46.245191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.302065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 115/219] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:46.328677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.428377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2e20-5f5c-4abd-96d0-d9fb9c0c7fcb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.468210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.469014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.469295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.469566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.471118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:46.472192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:46.474311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 105/220] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:46.479625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.502344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f8735-e16c-4735-8555-37baffc156e5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.535678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1052a1-de51-4039-9600-84672d103db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.536489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1052a1-de51-4039-9600-84672d103db2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.536773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1052a1-de51-4039-9600-84672d103db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.537044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1052a1-de51-4039-9600-84672d103db2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.547846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1052a1-de51-4039-9600-84672d103db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:46.555368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-3d1052a1-de51-4039-9600-84672d103db2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:46.562230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 116/221] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:46.562230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9279-23fb-4b28-abec-d826b5d8de33 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.562230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9279-23fb-4b28-abec-d826b5d8de33 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.562230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9279-23fb-4b28-abec-d826b5d8de33 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.562230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 117/222] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:46.565230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9279-23fb-4b28-abec-d826b5d8de33 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.586977 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420d2d6-0aa3-4003-9a06-4812b665d275 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.620639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.621439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.621957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.622335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.623049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:46.624491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:46.666081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9279-23fb-4b28-abec-d826b5d8de33 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.699421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.700360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.700649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.700931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.701688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:46.702000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:46.703459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af35a-63e3-45fd-91d8-e81b53b1296f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:46.711593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 118/223] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:46.712593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.712917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.713199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.717032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 106/224] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:46 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:46.729434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.732120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:46.733358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:46.809063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 119/225] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:46.832789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.862753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0cd8a-acc1-40f9-95c4-ed5145102981 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:46.907585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:46.909199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:46.910501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:46.910995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] PATH_INFO: `/v3/users/ceb6fcd762d44d61acd83b0c58a226ef` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:46.928627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb6fcd762d44d61acd83b0c58a226ef)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:46.930010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:46.931782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 107/226] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:46 2022] GET /identity/v3/users/ceb6fcd762d44d61acd83b0c58a226ef => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:46.938604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:46.958347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56540f08-7eaa-486b-a073-2350d5d2797b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.012896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.014043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.014904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.015186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.030516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:47.038351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:58:47.039780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 120/227] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:58:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:47.046546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:47.058450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa87a7-78d6-41cb-9314-57fd0214d714 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.100070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.101045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.101472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.101891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.187850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb423e-c0e6-477f-91cd-3a0ef6f6dac3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.190480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.192177 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.234396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.235479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.235764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.236045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.236807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:47.237454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.239188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.249043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 121/228] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:58:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:47.255984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:47.302443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 108/229] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:47.311326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:47.366145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e64e7-fdf0-427b-a3f4-c0438865c8a9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.395949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.395949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.395949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.395949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] PATH_INFO: `/v3/users/93cd3a396460418c82f2c438bb3ff746` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.398991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] RBAC: Authorizing `identity:get_user(user_id=93cd3a396460418c82f2c438bb3ff746)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.400512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.402978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 122/230] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:47 2022] GET /identity/v3/users/93cd3a396460418c82f2c438bb3ff746 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:47.408417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:47.488936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cfcf5-0e7a-44c2-bcc2-7b6bc9dfe745 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.513023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b34722-e1fd-4bea-972d-05b5beb7990a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.547991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.548212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.548864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.548962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.549149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.549251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.549427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.549518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.550743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.552191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.553904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 123/231] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:47 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:47.554910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.556341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.558307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 109/232] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:47 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:47.559351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:47.563841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:47.663649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575305a6-f513-42fe-a820-df160d5c8ea6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.697088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09351e5-bb03-4ee3-9093-9b5459774857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.697982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09351e5-bb03-4ee3-9093-9b5459774857 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.698294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09351e5-bb03-4ee3-9093-9b5459774857 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.698570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09351e5-bb03-4ee3-9093-9b5459774857 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/93cd3a396460418c82f2c438bb3ff746/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.702445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09351e5-bb03-4ee3-9093-9b5459774857 None admin] RBAC: Authorizing `identity:create_grant(project_id=996e7dd26aac4b0185bc47055a3a2d9d, user_id=93cd3a396460418c82f2c438bb3ff746, role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.703881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09351e5-bb03-4ee3-9093-9b5459774857 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.740179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629eabd-de62-4c36-b48e-b068b89cee77 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:47.781215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:47.781880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:47.782188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:47.782466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:47.783306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=ceb6fcd762d44d61acd83b0c58a226ef) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:47.783669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:47.785288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9894ae-619b-4946-8bf0-8b698c96a33e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:47.791230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 110/233] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:47 2022] GET /identity/v3/role_assignments?user.id=ceb6fcd762d44d61acd83b0c58a226ef&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=7f61ee9da37149509268e80d31dea384 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:47.817722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 124/234] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:47 2022] PUT /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/93cd3a396460418c82f2c438bb3ff746/roles/b51956c831c84838aece85c3cb553f84 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 12:58:48.728533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12103baf-86d2-4470-9435-30ed58bcbecb None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:48.729457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12103baf-86d2-4470-9435-30ed58bcbecb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:48.729922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12103baf-86d2-4470-9435-30ed58bcbecb None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:48.731701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 111/235] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:48.736903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:48.737679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:48.738221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:48.755136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:48.756575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:48.823962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 125/236] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:48.849117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12103baf-86d2-4470-9435-30ed58bcbecb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:48.967059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12103baf-86d2-4470-9435-30ed58bcbecb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:49.017064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:49.017781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.018060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.018366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.035012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:49.042441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:58:49.044032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 112/237] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:49.049903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:49.150614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17642-8ce7-468f-a2ff-1cfdd50915da None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:49.185323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:49.186529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.187061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.187525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.188483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:49.188974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:49.190556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:49.199649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 126/238] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:49.205410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:49.355986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068b14-a8f1-428e-a57d-5a5426932b0d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:49.419054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e8216-6f7d-4cd8-9285-4ec8e7921a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:49.419970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e8216-6f7d-4cd8-9285-4ec8e7921a98 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.420254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e8216-6f7d-4cd8-9285-4ec8e7921a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.420533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e8216-6f7d-4cd8-9285-4ec8e7921a98 None admin] PATH_INFO: `/v3/users/93cd3a396460418c82f2c438bb3ff746` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.421871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e8216-6f7d-4cd8-9285-4ec8e7921a98 None admin] RBAC: Authorizing `identity:get_user(user_id=93cd3a396460418c82f2c438bb3ff746)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:49.423394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e8216-6f7d-4cd8-9285-4ec8e7921a98 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:49.425477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 113/239] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:49 2022] GET /identity/v3/users/93cd3a396460418c82f2c438bb3ff746 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:49.430885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:49.577500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318f796-2398-4f18-93f9-4f2396154eaa None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:49.628252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:49.628839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.629124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.629401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.713686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5f0f-3b61-41eb-ba1b-c9292080c093 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.714343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5f0f-3b61-41eb-ba1b-c9292080c093 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.714823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5f0f-3b61-41eb-ba1b-c9292080c093 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.717492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 114/240] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:49.722196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:49.722196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:49.724154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.724538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.724911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.770034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:49.771249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:49.822245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 127/241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:49.827931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:49.926645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec543b-ab55-40cc-b65c-46252feba0b8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:49.956431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 115/242] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:49.960569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:49.961661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:49.962079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:49.962516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:49.963847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:49.966235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:49.968162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 128/243] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:49 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:49.975462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:49.986600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.086966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1bbed-8a66-46dc-aebb-7d54f95a8b67 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.122375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.123523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.123997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.124459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.135051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:50.142992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:50.144477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 129/244] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:50.150273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.163424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d467d-f6ac-4f97-a2d9-731ecee7cbab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.265975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aa30e-e6bb-460a-9e09-a84a9cda960d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.301342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.302524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.303101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.303607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.304526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:50.305011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:50.306573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128dc62-4d89-474a-9cc1-f5538b40404b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:50.316237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 130/245] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:50.320798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67aeab-ef59-4627-9c05-384cda014d33 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.320798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67aeab-ef59-4627-9c05-384cda014d33 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.320798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67aeab-ef59-4627-9c05-384cda014d33 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.321674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 131/246] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:50.322401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67aeab-ef59-4627-9c05-384cda014d33 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.329070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.330696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.330981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.331257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.332103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=93cd3a396460418c82f2c438bb3ff746) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:50.332413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:50.333881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4527f-c9df-4278-a3ac-5ad0eac79c8b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:50.341363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 116/247] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:49 2022] GET /identity/v3/role_assignments?user.id=93cd3a396460418c82f2c438bb3ff746&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:50.342683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.343020 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.343295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.363883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:50.365519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:50.507427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67aeab-ef59-4627-9c05-384cda014d33 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.510866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 117/248] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:50.548385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.549313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.549594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.549869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] PATH_INFO: `/v3/users/f9eacbd95e79408d9ed1c40c1e8f13f1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.558051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.581363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f9eacbd95e79408d9ed1c40c1e8f13f1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:50.583744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:50.585517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 132/249] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:50 2022] GET /identity/v3/users/f9eacbd95e79408d9ed1c40c1e8f13f1 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:50.591409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.672627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f752465-902d-4c84-ae57-a3c1754ddd98 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.695514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c4433-2a21-4761-99a4-6fea3e3967d6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.708471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.709276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.709558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.709832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.711090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:50.712544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:50.716251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 118/250] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:50.720305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.740815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f12aa-0fb2-4047-aa34-e7e8fdcb64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.741815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f12aa-0fb2-4047-aa34-e7e8fdcb64de None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.742148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f12aa-0fb2-4047-aa34-e7e8fdcb64de None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.742409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f12aa-0fb2-4047-aa34-e7e8fdcb64de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.818447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f12aa-0fb2-4047-aa34-e7e8fdcb64de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:50.820206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f12aa-0fb2-4047-aa34-e7e8fdcb64de None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:50.841323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b242-32f0-4d5e-9714-0bd460c75a31 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:50.874596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db994-e9c6-4538-bc0b-660c3379c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:50.875266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db994-e9c6-4538-bc0b-660c3379c761 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.875548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db994-e9c6-4538-bc0b-660c3379c761 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.875824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db994-e9c6-4538-bc0b-660c3379c761 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.876527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db994-e9c6-4538-bc0b-660c3379c761 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:50.877955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db994-e9c6-4538-bc0b-660c3379c761 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:50.920091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 133/251] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:50.921997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace8d6c-deaf-42bf-8ed7-03e867e6639c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:50.922349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace8d6c-deaf-42bf-8ed7-03e867e6639c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:50.922629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace8d6c-deaf-42bf-8ed7-03e867e6639c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:50.924053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 134/252] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:50.926942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace8d6c-deaf-42bf-8ed7-03e867e6639c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:50.999571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 119/253] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:50 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 12:58:51.000965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4a00-3eeb-4460-942e-345c8b6fb1f5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.001253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4a00-3eeb-4460-942e-345c8b6fb1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.001550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4a00-3eeb-4460-942e-345c8b6fb1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.019133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5e2f4a00-3eeb-4460-942e-345c8b6fb1f5 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:51.020383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5e2f4a00-3eeb-4460-942e-345c8b6fb1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:51.027074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace8d6c-deaf-42bf-8ed7-03e867e6639c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.065911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f24c-cc64-430b-892d-7426c984d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.067194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f24c-cc64-430b-892d-7426c984d580 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.067692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f24c-cc64-430b-892d-7426c984d580 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.067987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f24c-cc64-430b-892d-7426c984d580 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.069390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22f24c-cc64-430b-892d-7426c984d580 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.070845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22f24c-cc64-430b-892d-7426c984d580 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.077950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 135/254] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:50 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:51.077950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e849-b2bb-45fe-91d3-e863ec5052a3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.077950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e849-b2bb-45fe-91d3-e863ec5052a3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.077950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e849-b2bb-45fe-91d3-e863ec5052a3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.077950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 136/255] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:51.079421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e849-b2bb-45fe-91d3-e863ec5052a3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.101799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 120/256] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:51.103513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.103913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.104281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.122227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:51.123566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:51.198877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 121/257] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:51.201518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e849-b2bb-45fe-91d3-e863ec5052a3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.207088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.246156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.246940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.247216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.247583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.254237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] RBAC: Adding query filter params (role.id=30bf9be1f3194301a4dbdc699b3931f1, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=f9eacbd95e79408d9ed1c40c1e8f13f1) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:51.254237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.254237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.255683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 137/258] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/role_assignments?user.id=f9eacbd95e79408d9ed1c40c1e8f13f1&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=30bf9be1f3194301a4dbdc699b3931f1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:51.256556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.319793 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0837-1a4f-4155-af47-7984c39167f9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.359105 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.359919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.360193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.360465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.372777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:51.380438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:51.381729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 122/259] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:51.384383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d3a8-6bca-427c-ace4-3b4757e1f55a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.388709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.421217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.422055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.422368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.422641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.434351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:51.441925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:58:51.443239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 138/260] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:51.450031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.499381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36563fc-5017-4827-ab25-5f96ebd29b03 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.534757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.535438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.535720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.535996 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.536758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:51.537065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.538485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.547826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 123/261] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:51.554618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.556334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a640e5-265e-4787-9763-30e036f56fcb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.590395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.590991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.591272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.591547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.592300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:51.592607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.593977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.603339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 139/262] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:51.609448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.658075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2284d4-f55c-4bae-af1e-69e1b2ca8e4c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.692365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.693244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.693575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.693854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] PATH_INFO: `/v3/users/ceb6fcd762d44d61acd83b0c58a226ef` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.695145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] RBAC: Authorizing `identity:get_user(user_id=ceb6fcd762d44d61acd83b0c58a226ef)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.696598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.698285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 124/263] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/users/ceb6fcd762d44d61acd83b0c58a226ef => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:51.703853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.711739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314b59-2832-47fe-a52c-da03505f0e9e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.745292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.746797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.747077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.747345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] PATH_INFO: `/v3/users/93cd3a396460418c82f2c438bb3ff746` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.748548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] RBAC: Authorizing `identity:get_user(user_id=93cd3a396460418c82f2c438bb3ff746)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.750870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.752822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 140/264] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/users/93cd3a396460418c82f2c438bb3ff746 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:51.758065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.805264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273da2-30c2-4400-9938-c6a1ddce61b2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.839553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.841206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.841439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.842013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.842997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.844497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.846540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 125/265] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:51.852334 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:51.857227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c08e-45bb-45ae-806f-60ee031cb38b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:51.889739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:51.890428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:51.890709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:51.890986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:51.958448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:51.959921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:51.997725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e310-3824-4ca8-b871-1d6d6a26f187 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:52.066820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:52.068227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:52.068698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:52.069158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/ceb6fcd762d44d61acd83b0c58a226ef/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:52.071415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] RBAC: Authorizing `identity:create_grant(project_id=996e7dd26aac4b0185bc47055a3a2d9d, user_id=ceb6fcd762d44d61acd83b0c58a226ef, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:52.073068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:52.086157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 141/266] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:58:52.100386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:52.160561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 126/267] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:51 2022] PUT /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/ceb6fcd762d44d61acd83b0c58a226ef/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:52.193505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded24a9b-d4c5-4cdb-a07e-ba05acd1d421 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:52.231784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6e20c-1cd0-43fa-805f-f1ec2f960d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:52.232985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e20c-1cd0-43fa-805f-f1ec2f960d87 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:52.233443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e20c-1cd0-43fa-805f-f1ec2f960d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:52.233892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e20c-1cd0-43fa-805f-f1ec2f960d87 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:52.235580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6e20c-1cd0-43fa-805f-f1ec2f960d87 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:52.237246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6e20c-1cd0-43fa-805f-f1ec2f960d87 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:52.239563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 142/268] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:52 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:52.245666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:52.414788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5d1b-554b-4960-a3c3-c0e99811b885 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:52.455151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:52.456152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:52.456761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:52.457290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:52.458698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] RBAC: Adding query filter params (role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=93cd3a396460418c82f2c438bb3ff746) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:52.459201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:52.460876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7979-6304-411b-a180-899a06c80a8e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:52.472913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 127/269] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:52 2022] GET /identity/v3/role_assignments?user.id=93cd3a396460418c82f2c438bb3ff746&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=b51956c831c84838aece85c3cb553f84 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:53.753703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e77f-0d7a-40d9-9851-36932138ab64 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:53.754212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e77f-0d7a-40d9-9851-36932138ab64 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:53.754212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e77f-0d7a-40d9-9851-36932138ab64 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:53.755977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 143/270] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:53.762377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426af1-2529-4ba5-ad3e-1827082c6769 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:53.762882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426af1-2529-4ba5-ad3e-1827082c6769 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:53.763078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39426af1-2529-4ba5-ad3e-1827082c6769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:53.781872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-39426af1-2529-4ba5-ad3e-1827082c6769 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:53.783165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-39426af1-2529-4ba5-ad3e-1827082c6769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:53.852165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 128/271] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:53.876804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e77f-0d7a-40d9-9851-36932138ab64 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:53.961770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100a68-5ea3-45cd-a3f5-2c041706a44f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:53.962085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100a68-5ea3-45cd-a3f5-2c041706a44f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:53.962400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100a68-5ea3-45cd-a3f5-2c041706a44f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:53.964055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 129/272] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:53.969582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:53.969871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:53.970182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:53.985372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e77f-0d7a-40d9-9851-36932138ab64 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:53.988461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:53.989674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:54.021107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.021913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.022222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.022500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.035800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:54.045400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:54.047475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 144/273] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:54.052554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.062546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 130/274] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:54.085749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.156989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641034f-65a7-4e8e-ad05-37b6b8b128a4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.190657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.191324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.191606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.191890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.192643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:54.192953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.194356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edecd96-4780-4793-8c9e-834282e3cabe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.197622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524deb0-13b8-4271-a2f1-ad0e5f12cfe4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.202277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 145/275] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:54.203535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180157b-04e5-4689-b8fc-8ded6c392a8a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.203824 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180157b-04e5-4689-b8fc-8ded6c392a8a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.204098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180157b-04e5-4689-b8fc-8ded6c392a8a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.209087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 146/276] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:54.209087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180157b-04e5-4689-b8fc-8ded6c392a8a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.236800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd458-6e52-4475-b04b-e01c7fd4774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.237603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd458-6e52-4475-b04b-e01c7fd4774e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.237891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd458-6e52-4475-b04b-e01c7fd4774e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.238321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd458-6e52-4475-b04b-e01c7fd4774e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.249354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fd458-6e52-4475-b04b-e01c7fd4774e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:54.256485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-be0fd458-6e52-4475-b04b-e01c7fd4774e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:54.264601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 131/277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:54.265797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.266091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.266398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.282969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:54.284108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:54.366136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 132/278] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:54.366136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.434474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180157b-04e5-4689-b8fc-8ded6c392a8a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.467564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.468541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.468826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.469102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] PATH_INFO: `/v3/users/5536416092e942658a4eb2c7feb8153c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.473499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6c1ea-123e-49dd-b765-f4b214c4212d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.483369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] RBAC: Authorizing `identity:get_user(user_id=5536416092e942658a4eb2c7feb8153c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.484812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.486560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 147/279] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/users/5536416092e942658a4eb2c7feb8153c => generated 293 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:54.491034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.511214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.512567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.512857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.513130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.513891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:54.514230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.515612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.523851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 133/280] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:54.527026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.589619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e85f-b87b-4229-bbf8-355e9654db4d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.623250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.624036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.624314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.624585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.625741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.627192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.628816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 148/281] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:54.629572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.640951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101f68-0f3b-4519-8cbe-7339b851d473 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.675123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.676180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.676465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.676742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.677572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, user.id=5536416092e942658a4eb2c7feb8153c, scope.system=all) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:54.677883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.679362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.684377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 134/282] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/role_assignments?user.id=5536416092e942658a4eb2c7feb8153c&scope.system=all&role.id=7f61ee9da37149509268e80d31dea384 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:54.685141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.729760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a7b0-14c3-4a88-8d5c-ad0f6ba851d2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.765183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2c5c7-214c-4000-a509-b9e4fd674927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.766085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2c5c7-214c-4000-a509-b9e4fd674927 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.766449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2c5c7-214c-4000-a509-b9e4fd674927 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.766741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2c5c7-214c-4000-a509-b9e4fd674927 None admin] PATH_INFO: `/v3/users/f9eacbd95e79408d9ed1c40c1e8f13f1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.768489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2c5c7-214c-4000-a509-b9e4fd674927 None admin] RBAC: Authorizing `identity:get_user(user_id=f9eacbd95e79408d9ed1c40c1e8f13f1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.770812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2c5c7-214c-4000-a509-b9e4fd674927 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.773438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 149/283] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/users/f9eacbd95e79408d9ed1c40c1e8f13f1 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:54.775684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf748a70-aa22-4dfe-86fd-fe86dcb24067 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.776236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf748a70-aa22-4dfe-86fd-fe86dcb24067 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.776710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf748a70-aa22-4dfe-86fd-fe86dcb24067 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.779156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 150/284] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:54.781269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf748a70-aa22-4dfe-86fd-fe86dcb24067 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:54.796843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17037aa5-1907-4fc7-8b26-6a2ec28733ea None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.832392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb5f2a-56da-4760-8b69-17125d2771c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.833277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb5f2a-56da-4760-8b69-17125d2771c1 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.833561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb5f2a-56da-4760-8b69-17125d2771c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.833836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb5f2a-56da-4760-8b69-17125d2771c1 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.834597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb5f2a-56da-4760-8b69-17125d2771c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.836079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb5f2a-56da-4760-8b69-17125d2771c1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.885361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf748a70-aa22-4dfe-86fd-fe86dcb24067 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:54.907352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 135/285] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:58:54 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:54.908476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.908764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.909038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.927028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:54.928673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:54.934481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:54.935521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:54.935861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:54.936202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:54.937820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:54.939566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:54.941626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 151/286] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:54 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:54.947750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:55.006915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 136/287] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:55.032545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:55.062326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989e17d-e04c-4ce0-921d-79f4246aade4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:55.101439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:55.102715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:55.103171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:55.103635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/f9eacbd95e79408d9ed1c40c1e8f13f1/roles/30bf9be1f3194301a4dbdc699b3931f1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:55.106016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] RBAC: Authorizing `identity:create_grant(project_id=996e7dd26aac4b0185bc47055a3a2d9d, user_id=f9eacbd95e79408d9ed1c40c1e8f13f1, role_id=30bf9be1f3194301a4dbdc699b3931f1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:55.107831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:55.150097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae05c-7d9b-4fc6-8a34-8c13a2a6fa4f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:55.175772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 152/288] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:58:54 2022] PUT /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/users/f9eacbd95e79408d9ed1c40c1e8f13f1/roles/30bf9be1f3194301a4dbdc699b3931f1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:55.191696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:55.192964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:55.193505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:55.193972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:55.207243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:55.214655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:55.216181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 137/289] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:58:55.222337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:55.336777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6e53f-1f79-4f27-b734-2617d951c336 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:55.376158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:55.376848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:55.377124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:55.377400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:55.378180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:55.378492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:55.379935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:55.389716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 153/290] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:55.395312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:55.506242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f490e0-526c-4deb-8bb9-b888d89d7ed2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:55.549014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:55.549893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:55.550195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:55.550470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] PATH_INFO: `/v3/users/ceb6fcd762d44d61acd83b0c58a226ef` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:55.554839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] RBAC: Authorizing `identity:get_user(user_id=ceb6fcd762d44d61acd83b0c58a226ef)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:55.556290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:55.558227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 138/291] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:55 2022] GET /identity/v3/users/ceb6fcd762d44d61acd83b0c58a226ef => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:55.564751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:55.710744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92757d0-e363-4499-9746-ed961a094b0f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:55.744763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:55.745417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:55.745700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:55.745976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:55.814416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:55.815936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:55.918231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 154/292] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:55.919894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:56.022338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a54a90-56ce-4227-851a-d066bcda953f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:56.058326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa8f95-2675-4603-82b8-45ed7f86349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:56.059877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa8f95-2675-4603-82b8-45ed7f86349d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:56.060167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa8f95-2675-4603-82b8-45ed7f86349d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:56.060442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa8f95-2675-4603-82b8-45ed7f86349d None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:56.061633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa8f95-2675-4603-82b8-45ed7f86349d None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:56.063097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa8f95-2675-4603-82b8-45ed7f86349d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:56.065282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 139/293] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:55 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:56.071038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:56.172293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ea96-32a3-4f5f-be19-863a1963865a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:56.206896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:56.207560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:56.207840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:56.208116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:56.208960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=ceb6fcd762d44d61acd83b0c58a226ef) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:56.209272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:56.210733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab47c-4ccf-4ff8-877a-f64efc530c98 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:56.216881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 155/294] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:56 2022] GET /identity/v3/role_assignments?user.id=ceb6fcd762d44d61acd83b0c58a226ef&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=7f61ee9da37149509268e80d31dea384 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:57.369209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ecac-ad90-4ed0-8121-95b0c33b241d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.370244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ecac-ad90-4ed0-8121-95b0c33b241d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.370746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513ecac-ad90-4ed0-8121-95b0c33b241d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.373284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 140/295] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:57.379103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.379962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.385560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.409918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:57.411458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:57.485863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 156/296] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:57.508255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513ecac-ad90-4ed0-8121-95b0c33b241d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:57.618602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513ecac-ad90-4ed0-8121-95b0c33b241d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:57.657687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:57.658845 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.659335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.659832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.670685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:57.678508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:58:57.680070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 141/297] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:57.686188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:57.787567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c5b7-405f-4be9-8e1d-1d08e2a68a34 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:57.822173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:57.823193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.823676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.824237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.825768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:57.826315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:57.827879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3546dde-e7f0-45b3-8ec2-64ebee98bf06 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:57.836509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 157/298] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:57.844289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:57.851106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc48d-f9b1-4ce9-b5b8-1ddea382cff3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.851395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc48d-f9b1-4ce9-b5b8-1ddea382cff3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.851674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc48d-f9b1-4ce9-b5b8-1ddea382cff3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.853037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 158/299] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:58:57.859147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a69e77-c5bf-40c5-8b7d-72fc105902c2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.859432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a69e77-c5bf-40c5-8b7d-72fc105902c2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.859718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a69e77-c5bf-40c5-8b7d-72fc105902c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.877537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a3a69e77-c5bf-40c5-8b7d-72fc105902c2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:57.878819 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a3a69e77-c5bf-40c5-8b7d-72fc105902c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:57.946367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 159/300] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:57.947651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15e58-e0d6-47cd-8b92-af234a2f7708 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.947942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15e58-e0d6-47cd-8b92-af234a2f7708 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.948218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15e58-e0d6-47cd-8b92-af234a2f7708 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.949804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 160/301] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:57.956083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad8a7-7f83-44af-9f81-23cfc14a02f3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:57.956368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad8a7-7f83-44af-9f81-23cfc14a02f3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:57.956646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad8a7-7f83-44af-9f81-23cfc14a02f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:57.974373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5da3c2-a3c1-433a-8be3-8603b60207b7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:57.974591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-456ad8a7-7f83-44af-9f81-23cfc14a02f3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:57.975771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-456ad8a7-7f83-44af-9f81-23cfc14a02f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:58.008203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.009077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.009358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.009625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] PATH_INFO: `/v3/users/5536416092e942658a4eb2c7feb8153c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.010945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] RBAC: Authorizing `identity:get_user(user_id=5536416092e942658a4eb2c7feb8153c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.012513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.014157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 142/302] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:57 2022] GET /identity/v3/users/5536416092e942658a4eb2c7feb8153c => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:58.014921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.044667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 161/303] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:58:58.047083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff45dd-d951-4382-9d47-297fe26467bf None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.047376 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff45dd-d951-4382-9d47-297fe26467bf None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.047657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff45dd-d951-4382-9d47-297fe26467bf None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.049119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 162/304] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:58:58.049672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff45dd-d951-4382-9d47-297fe26467bf None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.112345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07cde-38f7-4c5f-96b3-13f1df68f756 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.143259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16886a-b840-43f2-8a0f-a8176ee555e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.144054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16886a-b840-43f2-8a0f-a8176ee555e4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.144330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16886a-b840-43f2-8a0f-a8176ee555e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.144600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16886a-b840-43f2-8a0f-a8176ee555e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.145503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff45dd-d951-4382-9d47-297fe26467bf None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.154990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16886a-b840-43f2-8a0f-a8176ee555e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:58.161941 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5f16886a-b840-43f2-8a0f-a8176ee555e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:58.163166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 143/305] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:58.165515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.165805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.166092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.178748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.179606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.179882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.180153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] PATH_INFO: `/v3/system/users/5536416092e942658a4eb2c7feb8153c/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.181616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5536416092e942658a4eb2c7feb8153c, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.182578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:58:58.183012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.183945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:58:58.248890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 144/306] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:58:58.249683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.251272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 163/307] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Apr 11 12:58:58 2022] PUT /identity/v3/system/users/5536416092e942658a4eb2c7feb8153c/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:58:58.252230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.363402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dab56-42af-404b-9787-4d0ad64dc53b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.372276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582ca83-c218-4d45-9e2e-4265c1e1cfb3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.399016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.399694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.399974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.400247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.401005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:58.412603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.412603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.412603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 164/308] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:58.413721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.414791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.415414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.415929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.417696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.429561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:58:58.436685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:58:58.437943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 145/309] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:58:58.438823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.588968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc503-e654-4859-add4-f0b3194c3015 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.622334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.623130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.623415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.623693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.624645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c65c3-8d30-4761-97f9-02c2c21155e9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.624933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.626390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.628181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 165/310] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:58.628786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.663267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.664137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.664414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.664684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] PATH_INFO: `/v3/users/b84c43d4acbe4e39afc45048b9455aae` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.677881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] RBAC: Authorizing `identity:get_user(user_id=b84c43d4acbe4e39afc45048b9455aae)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.679669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.686555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 146/311] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/users/b84c43d4acbe4e39afc45048b9455aae => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:58.686555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.734654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85028588-f635-488a-bd2f-78fd14adc326 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.768913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.769668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.770023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.770489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.771219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:58.771531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.772885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.778806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae39e60-03d0-4e5a-8e7f-09d6314993ee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.781085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 166/312] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:58.781879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.815199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.815860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.816147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.816424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] PATH_INFO: `/v3/groups` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.817110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.818568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.877436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d23b3-3d7f-4652-9b77-e0fbcef787f4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:58.896297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 147/313] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Apr 11 12:58:58 2022] POST /identity/v3/groups => generated 229 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:58:58.907212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:58.911364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:58.912038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:58.912435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:58.912607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:58.913454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] RBAC: Adding query filter params (role.id=30bf9be1f3194301a4dbdc699b3931f1, user.id=b84c43d4acbe4e39afc45048b9455aae, scope.system=all) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:58.913763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:58.916701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:58.922485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 167/314] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/role_assignments?user.id=b84c43d4acbe4e39afc45048b9455aae&scope.system=all&role.id=30bf9be1f3194301a4dbdc699b3931f1 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:59.028222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9835-9b17-4e55-8779-a25d7fc4cc56 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:59.068700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:59.069613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:59.069894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:59.070214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] PATH_INFO: `/v3/users/f9eacbd95e79408d9ed1c40c1e8f13f1` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:59.071621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] RBAC: Authorizing `identity:get_user(user_id=f9eacbd95e79408d9ed1c40c1e8f13f1)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:59.073134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:59.075594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 148/315] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:58:58 2022] GET /identity/v3/users/f9eacbd95e79408d9ed1c40c1e8f13f1 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:58:59.083325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:59.194049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98b11-4701-4ab3-b9ae-8c6329cc791d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:59.228129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:59.228780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:59.229058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:59.229330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:59.297305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:59.298774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:59.397925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 168/316] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:58:59.403881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:59.504697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ec634-381a-48d4-b9e3-a11572aa59b8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:59.537817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25646a4e-3396-457e-b342-3d6f6429dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:59.538746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25646a4e-3396-457e-b342-3d6f6429dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:59.539074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25646a4e-3396-457e-b342-3d6f6429dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:59.539354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25646a4e-3396-457e-b342-3d6f6429dfb5 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:59.540523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25646a4e-3396-457e-b342-3d6f6429dfb5 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:59.541946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25646a4e-3396-457e-b342-3d6f6429dfb5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:59.544724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 149/317] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:58:59 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:58:59.550309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:58:59.648713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df137e8f-a9fc-4ade-8edf-2c1713ba8c08 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:58:59.682768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:58:59.683426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:58:59.683776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:58:59.684074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:58:59.684886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] RBAC: Adding query filter params (role.id=30bf9be1f3194301a4dbdc699b3931f1, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d, user.id=f9eacbd95e79408d9ed1c40c1e8f13f1) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:58:59.685192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:58:59.686645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04664e7a-1ea2-45e3-9555-f092c3d008e1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:58:59.692872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 169/318] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:58:59 2022] GET /identity/v3/role_assignments?user.id=f9eacbd95e79408d9ed1c40c1e8f13f1&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=30bf9be1f3194301a4dbdc699b3931f1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:00.607103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf470-f8b2-45de-adc1-395c6dfe0257 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:00.607656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf470-f8b2-45de-adc1-395c6dfe0257 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:00.607656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf470-f8b2-45de-adc1-395c6dfe0257 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:00.609061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 150/319] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:00.614448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:00.614862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:00.615043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:00.631851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:00.633034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:00.697268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 170/320] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:00.721723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bf470-f8b2-45de-adc1-395c6dfe0257 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:00.820788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bf470-f8b2-45de-adc1-395c6dfe0257 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:00.854490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:00.855286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:00.856648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:00.856648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:00.866392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:00.873473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:00.874868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 151/321] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:00.880404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:00.985658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b17e8a-5c2c-40fa-817f-ef7d4b8078d6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.018911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.019583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.019860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.020280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.021022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:01.021324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.022702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.031381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 171/322] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:01.036726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.131536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27bc42-14ef-4bf6-b7d7-d918bbd1a01f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.163461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cda7dc-8dac-499a-af3f-ee5eee75a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.164331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda7dc-8dac-499a-af3f-ee5eee75a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.164609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda7dc-8dac-499a-af3f-ee5eee75a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.164877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda7dc-8dac-499a-af3f-ee5eee75a7d2 None admin] PATH_INFO: `/v3/users/5536416092e942658a4eb2c7feb8153c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.166053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cda7dc-8dac-499a-af3f-ee5eee75a7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5536416092e942658a4eb2c7feb8153c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.167497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cda7dc-8dac-499a-af3f-ee5eee75a7d2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.169824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 152/323] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:59:01 2022] GET /identity/v3/users/5536416092e942658a4eb2c7feb8153c => generated 293 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:01.175513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.272307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72771a-0ae9-4b5e-a3e9-13753302a487 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.303743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.304397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.304562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96d61-7a22-4b8d-8b80-ea046ac75754 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.304677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.304853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96d61-7a22-4b8d-8b80-ea046ac75754 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.304951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.305132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae96d61-7a22-4b8d-8b80-ea046ac75754 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.305757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] RBAC: Adding query filter params (role.id=7f61ee9da37149509268e80d31dea384, user.id=5536416092e942658a4eb2c7feb8153c, scope.system=all) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:01.306063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.306674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 153/324] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:01.307633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fbfda-36f2-498b-b892-d25a76e19feb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.312035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.312327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.312610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.326136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 172/325] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Apr 11 12:59:01 2022] GET /identity/v3/role_assignments?user.id=5536416092e942658a4eb2c7feb8153c&scope.system=all&role.id=7f61ee9da37149509268e80d31dea384 => generated 510 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:01.329512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:01.330758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:01.353012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5db5-307f-4044-afe0-523f12291b3d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.353298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5db5-307f-4044-afe0-523f12291b3d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.353586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5db5-307f-4044-afe0-523f12291b3d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.355041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 173/326] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:01.361514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.361805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.362092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.379580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:01.380778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:01.408972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 154/327] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:01.431487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.457770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 174/328] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:01.482699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.536763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82beb7-2d29-499e-bfe2-be2d033f9e27 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.570885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.571682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.571961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.572240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.586738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:01.595799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a6bf-3c9c-4daa-9f95-838e25e01ae6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.599894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:59:01.602015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 155/329] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:01.607495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.631505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.632289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.632567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.632836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.633986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.635422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.637629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 175/330] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:01.642973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.701297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ce9a7-deb7-4f9a-b57f-687834bb551b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.732214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.732876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.733158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.733434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.734182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00aa89-a8e3-401c-bd99-cd13bb466162 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.734280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:01.734501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.735868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.743760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 156/331] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:01.751206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.766337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.766994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.767271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.767543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] PATH_INFO: `/v3/groups` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.768222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.769637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.847838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcca9ac-0c8c-4d3d-bbfb-fb5845ec3035 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:01.872970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 176/332] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Apr 11 12:59:01 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 12:59:01.882324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435da71-0866-43bb-bc5c-cb6c80dab43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:01.883342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435da71-0866-43bb-bc5c-cb6c80dab43e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:01.883560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435da71-0866-43bb-bc5c-cb6c80dab43e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:01.883848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435da71-0866-43bb-bc5c-cb6c80dab43e None admin] PATH_INFO: `/v3/users/b84c43d4acbe4e39afc45048b9455aae` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:01.885182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435da71-0866-43bb-bc5c-cb6c80dab43e None admin] RBAC: Authorizing `identity:get_user(user_id=b84c43d4acbe4e39afc45048b9455aae)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:01.886736 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435da71-0866-43bb-bc5c-cb6c80dab43e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:01.888485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 157/333] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:59:01 2022] GET /identity/v3/users/b84c43d4acbe4e39afc45048b9455aae => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:01.894395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:01.997266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea08ae-1d41-4cea-a133-479aa5af2485 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:02.031646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448581f5-63a6-4015-bc3d-522dc45ece70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:02.032523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448581f5-63a6-4015-bc3d-522dc45ece70 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:02.032816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448581f5-63a6-4015-bc3d-522dc45ece70 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:02.033075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448581f5-63a6-4015-bc3d-522dc45ece70 None admin] PATH_INFO: `/v3/system/users/b84c43d4acbe4e39afc45048b9455aae/roles/30bf9be1f3194301a4dbdc699b3931f1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:02.034656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448581f5-63a6-4015-bc3d-522dc45ece70 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b84c43d4acbe4e39afc45048b9455aae, role_id=30bf9be1f3194301a4dbdc699b3931f1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:02.036034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448581f5-63a6-4015-bc3d-522dc45ece70 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:02.096940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 177/334] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Apr 11 12:59:01 2022] PUT /identity/v3/system/users/b84c43d4acbe4e39afc45048b9455aae/roles/30bf9be1f3194301a4dbdc699b3931f1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:04.861901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa884-f81f-4612-aba4-2072b185f7b3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:04.861901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa884-f81f-4612-aba4-2072b185f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:04.861901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa884-f81f-4612-aba4-2072b185f7b3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:04.863060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 158/335] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:04.868851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc902-4216-4433-b320-aa56f1067c07 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:04.869683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc902-4216-4433-b320-aa56f1067c07 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:04.870226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc902-4216-4433-b320-aa56f1067c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:04.890566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dcddc902-4216-4433-b320-aa56f1067c07 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:04.892070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dcddc902-4216-4433-b320-aa56f1067c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:04.971211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 178/336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:05.015096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aa884-f81f-4612-aba4-2072b185f7b3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.082278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651274-c21d-431e-afe3-45a3da74cf70 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.082925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651274-c21d-431e-afe3-45a3da74cf70 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.083402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651274-c21d-431e-afe3-45a3da74cf70 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.085003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 179/337] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:05.099730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136290c-eb08-404e-9b2c-36106facdf5b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.100354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136290c-eb08-404e-9b2c-36106facdf5b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.100839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136290c-eb08-404e-9b2c-36106facdf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.137519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5136290c-eb08-404e-9b2c-36106facdf5b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:05.139033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5136290c-eb08-404e-9b2c-36106facdf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:05.147941 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aa884-f81f-4612-aba4-2072b185f7b3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.186408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104671a-1e92-4a80-8c40-6eaca2d3580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.187475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104671a-1e92-4a80-8c40-6eaca2d3580a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.187890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104671a-1e92-4a80-8c40-6eaca2d3580a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.188305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104671a-1e92-4a80-8c40-6eaca2d3580a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.200315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104671a-1e92-4a80-8c40-6eaca2d3580a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:05.207894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0104671a-1e92-4a80-8c40-6eaca2d3580a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 12:59:05.209679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 159/338] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:05.215612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d4fc-22c1-4ce6-b8fe-da6a43ee4211 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.216416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d4fc-22c1-4ce6-b8fe-da6a43ee4211 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.216846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d4fc-22c1-4ce6-b8fe-da6a43ee4211 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.218731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 160/339] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:05.220338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d4fc-22c1-4ce6-b8fe-da6a43ee4211 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.258322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 180/340] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:05.259722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4865-4568-488f-9c50-bc19f346c7fe None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.261064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4865-4568-488f-9c50-bc19f346c7fe None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.261064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4865-4568-488f-9c50-bc19f346c7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.283127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1e2f4865-4568-488f-9c50-bc19f346c7fe None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:05.289688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1e2f4865-4568-488f-9c50-bc19f346c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:05.365437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 181/341] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:05.371302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f84f-bb48-40bf-a693-2e0a1b8485d2 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.371757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f84f-bb48-40bf-a693-2e0a1b8485d2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.372209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f84f-bb48-40bf-a693-2e0a1b8485d2 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.373973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 182/342] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:05.374847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511f84f-bb48-40bf-a693-2e0a1b8485d2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.396639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d4fc-22c1-4ce6-b8fe-da6a43ee4211 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.433420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.435102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.435536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.435974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.436885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:05.438385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:05.439934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda25d4-0b0b-4645-a34d-60a47aa607db None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:05.449201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 161/343] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:05.451332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.451790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.452226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.474958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:05.476404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:05.503024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511f84f-bb48-40bf-a693-2e0a1b8485d2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.539774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.540843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.541273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.541693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.549982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 162/344] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:05.552865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:05.554991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.561702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:05.563153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 183/345] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:05.564047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.681404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad01fb-2f31-4add-a4aa-3485ee737cd1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.683216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30b4d-3449-4ebd-be7a-8520b98c7341 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.722241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.723353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.723792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.724025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.724631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] PATH_INFO: `/v3/users/b84c43d4acbe4e39afc45048b9455aae` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.725088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.725372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.725754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.726466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] RBAC: Authorizing `identity:get_user(user_id=b84c43d4acbe4e39afc45048b9455aae)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:05.728122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:05.729971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 184/346] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/users/b84c43d4acbe4e39afc45048b9455aae => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:05.731733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.749681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:05.760109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:05.762608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 163/347] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:05.763916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.849734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0073e-0cf6-4b4c-bcf4-b602945062f9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.887009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.888828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.889281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.889789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.890832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:05.891331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:05.891431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46726-1ed7-42d2-b66a-d1f8985b1221 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:05.893263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:05.902147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 185/348] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:05.903242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:05.925432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:05.926400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:05.927013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:05.927013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:05.937946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:05.945441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:05.946770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 164/349] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:05.947631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.013014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecb3d-d877-4106-9da5-92dce4c3ab3e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.047870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.048827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.049343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.049875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.049988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9325c-c99c-42f2-a3fc-744cb8c78cd0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.051024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] RBAC: Adding query filter params (role.id=30bf9be1f3194301a4dbdc699b3931f1, user.id=b84c43d4acbe4e39afc45048b9455aae, scope.system=all) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:06.051515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.053116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.066670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 186/350] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/role_assignments?user.id=b84c43d4acbe4e39afc45048b9455aae&scope.system=all&role.id=30bf9be1f3194301a4dbdc699b3931f1 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:06.067765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.086238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632101-709d-4109-b170-0cea0773ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.086855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632101-709d-4109-b170-0cea0773ecff None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.087204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632101-709d-4109-b170-0cea0773ecff None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.087547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632101-709d-4109-b170-0cea0773ecff None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.088363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632101-709d-4109-b170-0cea0773ecff None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:06.088753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632101-709d-4109-b170-0cea0773ecff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.091593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632101-709d-4109-b170-0cea0773ecff None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.101262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 165/351] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:06.106409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632101-709d-4109-b170-0cea0773ecff None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.213640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632101-709d-4109-b170-0cea0773ecff None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.219529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6b01b-c3fd-4507-ac68-8796f97b7f8e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.252561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.253305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.253677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.254346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.254891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:06.255268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.256745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.259853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c7b0f-271b-4210-af8c-9864e25f17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.260807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c7b0f-271b-4210-af8c-9864e25f17f0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.261293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c7b0f-271b-4210-af8c-9864e25f17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.262394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c7b0f-271b-4210-af8c-9864e25f17f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.267513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 166/352] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:06.268481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.342074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c7b0f-271b-4210-af8c-9864e25f17f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.343863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c7b0f-271b-4210-af8c-9864e25f17f0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.374903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516591aa-c76c-4995-82fc-e656291aa2b9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.415003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.415762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.416106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.416467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.480211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 187/353] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:06.481725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57760-93b5-4a25-9c5f-eedd20fb8f32 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.482019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57760-93b5-4a25-9c5f-eedd20fb8f32 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.486565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57760-93b5-4a25-9c5f-eedd20fb8f32 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.488112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 188/354] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:06.488939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d57760-93b5-4a25-9c5f-eedd20fb8f32 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.504184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.505666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.612110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d57760-93b5-4a25-9c5f-eedd20fb8f32 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.637862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 167/355] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:06.638626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.646741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.647392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.647669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.647941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.736932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.738340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.767905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ddbab-cfe8-4298-b529-9ac8b4d26cbf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:06.810610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856860-eb9b-4f62-b38f-a8ba732f077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:06.812064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856860-eb9b-4f62-b38f-a8ba732f077a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.812680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856860-eb9b-4f62-b38f-a8ba732f077a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.813147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856860-eb9b-4f62-b38f-a8ba732f077a None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.814888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856860-eb9b-4f62-b38f-a8ba732f077a None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:06.816344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856860-eb9b-4f62-b38f-a8ba732f077a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:06.818278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 168/356] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:06.823530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:06.823816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:06.824167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:06.847339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:06.848722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:06.853219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 189/357] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:06.854298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.924454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 169/358] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:06.925385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:06.963954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5162-5f07-4135-ae33-f0c1fb38831a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.003405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.004482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.004765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.005035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.006314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.007738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.009603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 190/359] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.011243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.029459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adeeac-b377-42cb-8982-43d29e6f8e0a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.065465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a1603-da3c-4d6a-9bbf-2ddc5fc1ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.066350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1603-da3c-4d6a-9bbf-2ddc5fc1ebfb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.066626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1603-da3c-4d6a-9bbf-2ddc5fc1ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.066896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1603-da3c-4d6a-9bbf-2ddc5fc1ebfb None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.073818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a1603-da3c-4d6a-9bbf-2ddc5fc1ebfb None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.075559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a1603-da3c-4d6a-9bbf-2ddc5fc1ebfb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.077296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 170/360] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:06 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.078655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b9cc-eaa3-47fd-b1f6-ac7e9ebfffc2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.081690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b9cc-eaa3-47fd-b1f6-ac7e9ebfffc2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.081690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b9cc-eaa3-47fd-b1f6-ac7e9ebfffc2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.081690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 171/361] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:07.081690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b9cc-eaa3-47fd-b1f6-ac7e9ebfffc2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.138149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9ad2-fba6-4beb-8e44-f061a3bc0f98 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.179210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.179210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.179210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.179210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.179687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.181107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.182889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 191/362] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.183804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.205915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b9cc-eaa3-47fd-b1f6-ac7e9ebfffc2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.243644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.244463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.244744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.245022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.258925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:07.265276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:07.269759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 172/363] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:07.269759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.298882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf20b-2509-42f3-be07-9b597bf81f6d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.337896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3f1c-e0dc-472f-b54f-9ad00bd3bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.339512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3f1c-e0dc-472f-b54f-9ad00bd3bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.339512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3f1c-e0dc-472f-b54f-9ad00bd3bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.339512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3f1c-e0dc-472f-b54f-9ad00bd3bbc9 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.341993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3f1c-e0dc-472f-b54f-9ad00bd3bbc9 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.343436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3f1c-e0dc-472f-b54f-9ad00bd3bbc9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.345091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 192/364] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.346457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.346730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.347004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.368112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:07.369278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:07.384361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66037-00ac-4224-9975-ef23d7028858 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.424110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.425026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.425026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.425315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.427320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:07.427449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.428844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.435204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 173/365] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=7f61ee9da37149509268e80d31dea384 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.436295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.452187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 193/366] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:07.452812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.573997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bab8c-65c9-4f0a-939b-6751bc208037 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.585401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb630fb5-2d97-4c7e-b28a-8303a403d744 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.617046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.617908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.619009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.619009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.620244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.622408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.624189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 174/367] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.624956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.626870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.627551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.627890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.628091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.628847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:07.629152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.633247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.641684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 194/368] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.643466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.758623 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e307b-886a-4de0-bf12-3e69615ceb55 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.764848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8360c-9a21-4799-b0ba-e2cfb9352340 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.803924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.804590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.804875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.805153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.805984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:07.807277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.808842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.809735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.810826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.811176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.811531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.821408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 175/369] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=7f61ee9da37149509268e80d31dea384 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.821408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.838038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:07.846439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:07.847401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 195/370] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:07.854690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:07.935798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6438b-ac8a-4c4c-8d1c-777e3968e7b0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.971721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea03e-95a0-458a-9644-6d84dc924b07 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:07.978499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:07.979570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:07.980067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:07.980584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:07.981669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:07.982851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:07.985033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:07.993109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 176/371] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=b51956c831c84838aece85c3cb553f84 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:07.994725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:08.044427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.045464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.045951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.046460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.111207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82e31-f64f-49be-8fc8-5c93c0a5782c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:08.156546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.158011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.179693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.180786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.181894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.182913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.185188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:08.185759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.188816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.203077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 177/372] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:08.213525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:08.306291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 196/373] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:08.312489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:08.372675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1983-712a-40d9-afb9-bf9344e5af83 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:08.413071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfbf37-281b-4447-beab-f7b88d526c9e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:08.447921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.448788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.449107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.449384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.450770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.452201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.454258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 197/374] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:08 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:08.457805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.458580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.458866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.459147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.459525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:08.602789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.604781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.648562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8601d79-c1f5-4b44-91ce-98440111ef3c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:08.722507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.723746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.724489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.724974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.727676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.729341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.731792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 198/375] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:08 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:08.737500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:08.782979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 178/376] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:59:08.794810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:08.914216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5000440-a950-4e45-a2ed-2eac3e8a25d4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:08.945169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720216-87c6-4276-88eb-98ef243c1328 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:08.956819 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.957490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.957768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.958042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.958909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:08.959215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.960636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.972370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 199/377] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:08 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=b51956c831c84838aece85c3cb553f84 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:08.987435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:08.988319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:08.988600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:08.988878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] PATH_INFO: `/v3/projects/1a113afb28034953938db4779ef8e6eb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:08.990257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] RBAC: Authorizing `identity:get_project(project_id=1a113afb28034953938db4779ef8e6eb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:08.991722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:08.995439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 179/378] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:08 2022] GET /identity/v3/projects/1a113afb28034953938db4779ef8e6eb => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:08.999660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:09.136368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f3792-98b5-4d53-b542-e28c12fdf5e4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:09.175398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e282df-60a3-48a4-a35b-c2ceb2cdb4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:09.176395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e282df-60a3-48a4-a35b-c2ceb2cdb4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:09.176675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e282df-60a3-48a4-a35b-c2ceb2cdb4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:09.176950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e282df-60a3-48a4-a35b-c2ceb2cdb4f0 None admin] PATH_INFO: `/v3/groups/41d754e00f7a4713af3f618577efd16d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:09.183210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e282df-60a3-48a4-a35b-c2ceb2cdb4f0 None admin] RBAC: Authorizing `identity:get_group(group_id=41d754e00f7a4713af3f618577efd16d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:09.185273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e282df-60a3-48a4-a35b-c2ceb2cdb4f0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:09.187218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 200/379] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:08 2022] GET /identity/v3/groups/41d754e00f7a4713af3f618577efd16d => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:09.195175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:09.310022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74f6c-1c47-479f-9afc-77817ba3c8be None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:09.353379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:09.354485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:09.355022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:09.356082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:09.357338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] RBAC: Adding query filter params (group.id=41d754e00f7a4713af3f618577efd16d, role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=1a113afb28034953938db4779ef8e6eb) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:09.357877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:09.359571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123c3b8-6ebd-47a6-ae42-818f8e2250cd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:09.366205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 180/380] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:09 2022] GET /identity/v3/role_assignments?group.id=41d754e00f7a4713af3f618577efd16d&scope.project.id=1a113afb28034953938db4779ef8e6eb&role.id=278a0b419dab4b198abcf738011cdca6 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:10.144650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfb694-26b6-4c27-8297-8ee08578227f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.145194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfb694-26b6-4c27-8297-8ee08578227f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.145194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfb694-26b6-4c27-8297-8ee08578227f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:10.146885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 201/381] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:10.168371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.169431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.169914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:10.199618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:10.201083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:10.291806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 181/382] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:10.333231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfb694-26b6-4c27-8297-8ee08578227f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:10.453601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfb694-26b6-4c27-8297-8ee08578227f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:10.490885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:10.492071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.492545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.493031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:10.503345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:10.510809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:10.513108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 202/383] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:10.519245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:10.691923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4db19-7eac-4fac-ada6-a1939b2d2b17 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:10.741976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:10.742607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.742891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.743170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:10.743927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:10.744232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:10.745608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:10.755143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 182/384] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:10.762328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:10.903117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe93ca-be04-4a50-b6eb-7d30c0eca6ff None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:10.938301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1232121-c9bb-4454-8cf4-545f47d797db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:10.939557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1232121-c9bb-4454-8cf4-545f47d797db None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.940067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1232121-c9bb-4454-8cf4-545f47d797db None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.940537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1232121-c9bb-4454-8cf4-545f47d797db None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:10.942067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1232121-c9bb-4454-8cf4-545f47d797db None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:10.943781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1232121-c9bb-4454-8cf4-545f47d797db None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:10.945752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 203/385] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:10 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:10.955260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:10.984084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9d57-a19c-4a46-aab9-7ba9ba8dc1fd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.984715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9d57-a19c-4a46-aab9-7ba9ba8dc1fd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.985198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9d57-a19c-4a46-aab9-7ba9ba8dc1fd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:10.987063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 204/386] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:10.992502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:10.993064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:10.993558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.011058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:11.012695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:11.086217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 205/387] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:11.104099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.149798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8bd6d-6788-4d83-b36a-979fdf132ec8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.196021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c95ef4-0215-4ee5-b02e-3f9e8db6a2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.196895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c95ef4-0215-4ee5-b02e-3f9e8db6a2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.197177 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c95ef4-0215-4ee5-b02e-3f9e8db6a2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.197517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c95ef4-0215-4ee5-b02e-3f9e8db6a2e2 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.198674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c95ef4-0215-4ee5-b02e-3f9e8db6a2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:11.200850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c95ef4-0215-4ee5-b02e-3f9e8db6a2e2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:11.202863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 183/388] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:10 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:11.204200 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74577f7-6059-44ec-b6af-a02959501d20 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.204382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74577f7-6059-44ec-b6af-a02959501d20 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.204618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74577f7-6059-44ec-b6af-a02959501d20 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.207496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233c0e-7e07-4521-9e06-f133854a4d61 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.210911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 184/389] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:11.215129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74577f7-6059-44ec-b6af-a02959501d20 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.246495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9fbdc-8d05-4eb5-aa00-d48cdd28e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.247721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9fbdc-8d05-4eb5-aa00-d48cdd28e7be None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.248220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9fbdc-8d05-4eb5-aa00-d48cdd28e7be None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.248690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9fbdc-8d05-4eb5-aa00-d48cdd28e7be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.259985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9fbdc-8d05-4eb5-aa00-d48cdd28e7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:11.268395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-ded9fbdc-8d05-4eb5-aa00-d48cdd28e7be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:11.274205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 206/390] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:11.275676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.276154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.276618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.294987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:11.296500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:11.325389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74577f7-6059-44ec-b6af-a02959501d20 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.361279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.362298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.362583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.362889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/groups/14200b95b8ab4371ad849222f7b6663f/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.365263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7cd677d97e4258b86ab104b3b550c6, group_id=14200b95b8ab4371ad849222f7b6663f, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:11.365543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 207/391] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:11.366678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.375865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:11.470801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f0d44-71a1-422f-bb15-12d0bbbc50e2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.477080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 185/392] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Apr 11 12:59:11 2022] PUT /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/groups/14200b95b8ab4371ad849222f7b6663f/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:11.478342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.532029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.532840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.533054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.533336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.534265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:11.534489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:11.535960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:11.555311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 208/393] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:11.565187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.605253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f2e4-dcf2-41e4-99fe-1211a5bae3cd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.648907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2fd91-22d9-4bec-b8c5-41a0df5bd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.650324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2fd91-22d9-4bec-b8c5-41a0df5bd983 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.651263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2fd91-22d9-4bec-b8c5-41a0df5bd983 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.651959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2fd91-22d9-4bec-b8c5-41a0df5bd983 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.667239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2fd91-22d9-4bec-b8c5-41a0df5bd983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:11.676073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5db2fd91-22d9-4bec-b8c5-41a0df5bd983 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:11.677809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 186/394] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:11.679768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c71b-9576-4f99-9ef8-c527a31aa33c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.679768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c71b-9576-4f99-9ef8-c527a31aa33c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.679978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c71b-9576-4f99-9ef8-c527a31aa33c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.685918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 187/395] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:11.687026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c71b-9576-4f99-9ef8-c527a31aa33c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.720103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ed77-6d23-4741-8488-2af61d28a7df None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.765518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80719ef9-f6c2-4492-b3d2-be4204e959fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.766807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719ef9-f6c2-4492-b3d2-be4204e959fe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.767283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719ef9-f6c2-4492-b3d2-be4204e959fe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.767809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719ef9-f6c2-4492-b3d2-be4204e959fe None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.769248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80719ef9-f6c2-4492-b3d2-be4204e959fe None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:11.770964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80719ef9-f6c2-4492-b3d2-be4204e959fe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:11.773194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 209/396] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:11.774675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.775267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.775754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.794123 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:11.795658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:11.809100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c71b-9576-4f99-9ef8-c527a31aa33c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.851836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:11.852525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:11.852803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:11.853074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:11.854040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:11.854387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:11.857068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:11.867943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 210/397] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:11.869286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.878170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 188/398] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:11.883199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:11.997485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbfeb-4a6c-44b1-9a65-e94c7b4e8736 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:11.999256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5af204-6d35-4a10-9d29-2924a61049e0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.030908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.031994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.032517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.032769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.033100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.033634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.033910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.034246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.034890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.035428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.043626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.043761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.043761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 211/400] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:12.043761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.043978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 189/400] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:11 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:12.045792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.142004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfba76-4848-44b1-a1f0-c2d8f88b9f5f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.144304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf3d9-3766-4ac4-83a8-9fa130d7e7ca None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.176446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.177257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.177534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.177805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.181611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.182958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.184087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.184616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.186432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.188158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.188860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:12.190672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 190/401] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:12.191651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.203378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:12.209814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 212/402] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:12.209814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.316251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e440c6b-224e-4b98-8ce1-d398467e4c10 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.316896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2682b1-274c-4b4b-9adf-276f3ace454c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.351190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9302d-bdb4-4b66-82ed-78cad42a1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.351518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.352090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9302d-bdb4-4b66-82ed-78cad42a1d50 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.352302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.352400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9302d-bdb4-4b66-82ed-78cad42a1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.352583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.352677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9302d-bdb4-4b66-82ed-78cad42a1d50 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/groups/14200b95b8ab4371ad849222f7b6663f/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.352837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/groups/14200b95b8ab4371ad849222f7b6663f/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.355009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9302d-bdb4-4b66-82ed-78cad42a1d50 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7cd677d97e4258b86ab104b3b550c6, group_id=14200b95b8ab4371ad849222f7b6663f, role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.355124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=996e7dd26aac4b0185bc47055a3a2d9d, group_id=14200b95b8ab4371ad849222f7b6663f, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.357209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.357307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9302d-bdb4-4b66-82ed-78cad42a1d50 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.422648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 213/403] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Apr 11 12:59:12 2022] PUT /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/groups/14200b95b8ab4371ad849222f7b6663f/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:12.423728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.452146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 191/404] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Apr 11 12:59:12 2022] PUT /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6/groups/14200b95b8ab4371ad849222f7b6663f/roles/b51956c831c84838aece85c3cb553f84 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:12.453272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072221-0593-41ca-8e2a-e04d40324391 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.453555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072221-0593-41ca-8e2a-e04d40324391 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.453827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072221-0593-41ca-8e2a-e04d40324391 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.455196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 192/405] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:12.461292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fee803-cdca-425e-a100-007063b7100e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.461645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fee803-cdca-425e-a100-007063b7100e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.462004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fee803-cdca-425e-a100-007063b7100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.481014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-17fee803-cdca-425e-a100-007063b7100e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:12.482390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-17fee803-cdca-425e-a100-007063b7100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:12.561688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 193/406] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:12.579433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6e509-f1f3-42e5-9824-fcc5d80c0a72 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.614723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fee803-cdca-425e-a100-007063b7100e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.648414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.649106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.649385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.649658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.650544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:12.650749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.652793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.677707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 214/407] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:12.685035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.769968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fee803-cdca-425e-a100-007063b7100e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.803554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809bba-1ebb-4ac4-90dd-7e7f5ba8faaf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:12.809991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.810824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.811101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.811372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.823786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:12.832693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:12.834956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 194/408] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:12.841123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.847862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:12.849165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:12.849916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:12.850432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:12.852612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:12.854918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:12.858227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 215/409] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:12.864200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:12.988754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8b0b-0730-4f9b-84cd-68716e188175 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:13.029981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:13.030680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:13.030962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:13.031238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:13.031991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:13.032295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:13.033683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:13.051462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 195/410] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:13.058661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:13.067851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbd55e-7818-4cbd-8d82-09a4d180c0c5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:13.133376 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:13.134492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:13.134782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:13.135060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:13.139111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:13.140551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:13.143349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 216/411] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:12 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:13.148899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:13.228494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf94e8-8d78-4ea5-9f11-55c4bcdc527d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:13.290824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:13.291706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:13.291986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:13.292264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] PATH_INFO: `/v3/groups/41d754e00f7a4713af3f618577efd16d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:13.294191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] RBAC: Authorizing `identity:get_group(group_id=41d754e00f7a4713af3f618577efd16d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:13.294928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910d5e-3e47-4a20-8e67-230d102f4bed None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:13.295630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:13.297609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 196/412] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:13 2022] GET /identity/v3/groups/41d754e00f7a4713af3f618577efd16d => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:13.302753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:13.330154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:13.334127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:13.334127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:13.334127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/groups/14200b95b8ab4371ad849222f7b6663f/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:13.334127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] RBAC: Authorizing `identity:create_grant(project_id=996e7dd26aac4b0185bc47055a3a2d9d, group_id=14200b95b8ab4371ad849222f7b6663f, role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:13.335491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:13.401579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 217/413] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Apr 11 12:59:13 2022] PUT /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d/groups/14200b95b8ab4371ad849222f7b6663f/roles/b51956c831c84838aece85c3cb553f84 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 12:59:13.442796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9a1f-5283-436a-958e-11dae79ca180 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:13.485480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6895-d71e-4a93-9a25-6011d360435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:13.486384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6895-d71e-4a93-9a25-6011d360435e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:13.486671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6895-d71e-4a93-9a25-6011d360435e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:13.486948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6895-d71e-4a93-9a25-6011d360435e None admin] PATH_INFO: `/v3/projects/1a113afb28034953938db4779ef8e6eb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:13.488165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c6895-d71e-4a93-9a25-6011d360435e None admin] RBAC: Authorizing `identity:get_project(project_id=1a113afb28034953938db4779ef8e6eb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:13.489616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c6895-d71e-4a93-9a25-6011d360435e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:13.492452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 197/414] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:13 2022] GET /identity/v3/projects/1a113afb28034953938db4779ef8e6eb => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:13.497472 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:13.638570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2fba7-c9c0-4264-9535-7ee87b9da1cd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:13.674306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a588c8-643b-4098-a3f1-a9eec88b0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:13.675677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a588c8-643b-4098-a3f1-a9eec88b0d35 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:13.676156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a588c8-643b-4098-a3f1-a9eec88b0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:13.676623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a588c8-643b-4098-a3f1-a9eec88b0d35 None admin] PATH_INFO: `/v3/projects/1a113afb28034953938db4779ef8e6eb/groups/41d754e00f7a4713af3f618577efd16d/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:13.679796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a588c8-643b-4098-a3f1-a9eec88b0d35 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a113afb28034953938db4779ef8e6eb, group_id=41d754e00f7a4713af3f618577efd16d, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:13.681444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a588c8-643b-4098-a3f1-a9eec88b0d35 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:13.759557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 218/415] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Apr 11 12:59:13 2022] PUT /identity/v3/projects/1a113afb28034953938db4779ef8e6eb/groups/41d754e00f7a4713af3f618577efd16d/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:14.084183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109ec7-7544-4623-ab3d-0c45f783563e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:14.084875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109ec7-7544-4623-ab3d-0c45f783563e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:14.085353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109ec7-7544-4623-ab3d-0c45f783563e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:14.087510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 198/416] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:14.094391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:14.094928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:14.095398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:14.114675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:14.116126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:14.198304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 219/417] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:14.248624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8109ec7-7544-4623-ab3d-0c45f783563e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:14.371441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8109ec7-7544-4623-ab3d-0c45f783563e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:14.417145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:14.418016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:14.418369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:14.418652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:14.436225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:14.443434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:14.445094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 199/418] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:14.453844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:14.586460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a753964-218c-4bfe-bdd4-631e8171564b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:14.622143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:14.622749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:14.623075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:14.623357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:14.624113 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:14.624419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:14.625798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:14.634653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 220/419] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:14.639921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:14.782171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec1128-5076-429b-bc07-d57a7b82a040 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:14.826831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83ca07-9db5-4013-a8e2-8957d046a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:14.827495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ca07-9db5-4013-a8e2-8957d046a909 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:14.827783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ca07-9db5-4013-a8e2-8957d046a909 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:14.828060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ca07-9db5-4013-a8e2-8957d046a909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:14.901188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ca07-9db5-4013-a8e2-8957d046a909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:14.902906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ca07-9db5-4013-a8e2-8957d046a909 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:15.005436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 200/420] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:15.011219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.061848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c973-e91c-486a-9ecd-6cf1b7a770b4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.062169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c973-e91c-486a-9ecd-6cf1b7a770b4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.062450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c973-e91c-486a-9ecd-6cf1b7a770b4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.064139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 201/421] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:15.069276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.069596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.070000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.103742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:15.105076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:15.177776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 202/422] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:15.207013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6d539-f247-4737-b027-653ef790a6eb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:15.215997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.244220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:15.245084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.245364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.245633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.247559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:15.248995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:15.253106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 221/423] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:15.261175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.371610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e98126-ed75-4919-99be-5fe70d90baf0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:15.391993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc39f90-b290-48a6-8c87-274b315a2f40 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:15.422822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:15.423694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.423976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.424249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.425456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:15.427088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:15.428103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:15.429039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 222/424] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:15.429290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.429778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.430224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.435094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.442014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:15.449488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 12:59:15.451372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 203/425] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:15.457050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.576904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136858f-4273-4cb7-9b50-23182c7c773a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:15.585101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33453-b005-44ba-b325-8138008b4a38 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:15.617770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:15.619074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.619712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.620527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.621885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:15.622421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:15.624221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2fe62-d6ff-4852-acf9-1b9c91b18d3e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:15.624933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:15.625964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.626428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.627182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.628169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:15.628628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:15.630619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:15.637929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 204/426] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:15.639268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cc882-81dd-4148-a5be-b00516778599 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.639552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cc882-81dd-4148-a5be-b00516778599 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.639823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cc882-81dd-4148-a5be-b00516778599 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.640693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 223/427] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=7f61ee9da37149509268e80d31dea384 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:15.650611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 205/428] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:15.651262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.661730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.662277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.662729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.697870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:15.699160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:15.831468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceed976-d8c1-44be-978a-ab2e7bd64a2e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:15.840034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 206/429] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 11 12:59:15.872992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:15.877993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:15.878966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:15.879448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:15.879926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:15.949705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:15.951672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.000437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236eccf-d532-4afe-9f4c-e7530c3dc39d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.048384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.049229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.049506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.049846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.062400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:16.069889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:16.071545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 207/430] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:16.077410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.080420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 224/431] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:16.085866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.186300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e117-ce50-4df5-af3a-ef3f7da543ee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.190276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc2064-f2bf-43b3-99a7-0dd148517a97 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.221324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.222337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.222859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.223368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.224692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:16.225254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.226197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.227058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.227274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.227653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.228026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.229336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.231411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.233567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 225/432] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:16.237543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 208/433] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:16.242870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.245165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.353560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a8443-c81a-4657-881f-3a9f30157cd8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.356311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c947d-3dc0-4594-8c79-6770e0697079 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.389984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.391055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.391252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de601-d4c2-45d3-becb-cb069f6757f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.391361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.391627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.391904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de601-d4c2-45d3-becb-cb069f6757f2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.392183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de601-d4c2-45d3-becb-cb069f6757f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.392454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de601-d4c2-45d3-becb-cb069f6757f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.392831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.395743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.396436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 209/434] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:16.403756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.463037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de601-d4c2-45d3-becb-cb069f6757f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.464490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de601-d4c2-45d3-becb-cb069f6757f2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.521979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18020-eae8-42af-b7d0-c4054278edb1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.567292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.567957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.568241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.568517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.569355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=7f61ee9da37149509268e80d31dea384, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:16.569666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.571134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.575267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 226/435] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:16.576751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269034f5-7ade-4741-8af3-53d0b654a1e1 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.577042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269034f5-7ade-4741-8af3-53d0b654a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.577468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269034f5-7ade-4741-8af3-53d0b654a1e1 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.577881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 210/436] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=7f61ee9da37149509268e80d31dea384 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:16.579139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 227/437] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:16.583232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.584584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.584881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.585163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.604304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:16.606179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:16.694285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 228/438] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:16.720776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.722344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b340-e861-4e4d-9130-a9616931970e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.768153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cac452-71a8-4077-babc-2cd8ba6e0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.769861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac452-71a8-4077-babc-2cd8ba6e0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.770405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac452-71a8-4077-babc-2cd8ba6e0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.772735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac452-71a8-4077-babc-2cd8ba6e0ee2 None admin] PATH_INFO: `/v3/projects/8b7cd677d97e4258b86ab104b3b550c6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.774661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac452-71a8-4077-babc-2cd8ba6e0ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7cd677d97e4258b86ab104b3b550c6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.776369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac452-71a8-4077-babc-2cd8ba6e0ee2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.780009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 211/439] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/projects/8b7cd677d97e4258b86ab104b3b550c6 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:16.781592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0786b0-4005-40e4-b9c0-d45dd333715f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.782401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0786b0-4005-40e4-b9c0-d45dd333715f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.783117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0786b0-4005-40e4-b9c0-d45dd333715f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.784553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 212/440] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:16.785556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0786b0-4005-40e4-b9c0-d45dd333715f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.828310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ce7c-ce04-460f-a937-e9acbcaa8d85 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.863785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3eb8-2117-4b0c-8df0-11126d46caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.864594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3eb8-2117-4b0c-8df0-11126d46caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.864871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3eb8-2117-4b0c-8df0-11126d46caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.865144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3eb8-2117-4b0c-8df0-11126d46caa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.875182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc3eb8-2117-4b0c-8df0-11126d46caa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:16.882759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f9bc3eb8-2117-4b0c-8df0-11126d46caa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:16.883956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 229/441] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:16.885106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.885396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.885670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.895447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0786b0-4005-40e4-b9c0-d45dd333715f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:16.901285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:16.902999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:16.928392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:16.929235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:16.929510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:16.929787 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:16.930974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:16.932393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:16.934043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 213/442] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:16.934829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:16.966178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 230/443] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:16.967018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.029258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df30b5b-a49a-4d0f-9145-c8ccea11ead2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.059917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876b264-f160-48ee-aa99-8fa4d3392873 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.061465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.062150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.062430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.062699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.063433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:17.063734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.065101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.072652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 214/444] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:17.077910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.093049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.093756 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.093980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.094288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.095117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=8b7cd677d97e4258b86ab104b3b550c6) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:17.095424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.096870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.102702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 231/445] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:16 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=8b7cd677d97e4258b86ab104b3b550c6&role.id=b51956c831c84838aece85c3cb553f84 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:17.103468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.185855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bf0c0-80ff-4409-8de8-23b8cbdffa37 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.210150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6757735-3dc0-4b2d-89e3-f84984677e5b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.221855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.222695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.223182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.223456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.234874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:17.242312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:17.243503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 215/446] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:17.245914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38c00-9739-4896-b922-c82698971010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.246605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38c00-9739-4896-b922-c82698971010 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.246887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38c00-9739-4896-b922-c82698971010 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.247161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a38c00-9739-4896-b922-c82698971010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.249625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.317894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a38c00-9739-4896-b922-c82698971010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.319341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a38c00-9739-4896-b922-c82698971010 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.359826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107c81-b0a0-49c0-88a6-754b6f761734 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.400428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.401098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.401377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.401652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.404038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:17.404349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.405729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.416295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 216/447] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:17.422645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.423582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 232/448] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:17.432354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38c00-9739-4896-b922-c82698971010 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.529055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a38c00-9739-4896-b922-c82698971010 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.541568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06f92-8beb-4162-83b5-cf050aa4bfd2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.566514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.567442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.567724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.568221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] PATH_INFO: `/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.570969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] RBAC: Authorizing `identity:get_project(project_id=996e7dd26aac4b0185bc47055a3a2d9d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.570969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.573469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 233/449] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/projects/996e7dd26aac4b0185bc47055a3a2d9d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:17.578029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.579782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.580435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.580843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.581013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.651011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.652986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.683498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e98ec-4d92-4141-af41-4f8d314560ca None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.715453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.716298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.716571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.716836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] PATH_INFO: `/v3/groups/14200b95b8ab4371ad849222f7b6663f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.718007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] RBAC: Authorizing `identity:get_group(group_id=14200b95b8ab4371ad849222f7b6663f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.719533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.721151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 234/450] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/groups/14200b95b8ab4371ad849222f7b6663f => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:17.727110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.746404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 217/451] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:59:17.751882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.820195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2155c-eae8-4677-bf22-34048f4cc0e8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.844163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f37ef-0241-4d87-b886-4cda4d45d18f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:17.852854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.853497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.853777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.854051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.854905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] RBAC: Adding query filter params (group.id=14200b95b8ab4371ad849222f7b6663f, role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:17.855301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.856714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.862499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 235/452] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/role_assignments?group.id=14200b95b8ab4371ad849222f7b6663f&scope.project.id=996e7dd26aac4b0185bc47055a3a2d9d&role.id=b51956c831c84838aece85c3cb553f84 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:17.876814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:17.877698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:17.877979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:17.878289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] PATH_INFO: `/v3/projects/1a113afb28034953938db4779ef8e6eb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:17.879559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] RBAC: Authorizing `identity:get_project(project_id=1a113afb28034953938db4779ef8e6eb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:17.881056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:17.882911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 218/453] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/projects/1a113afb28034953938db4779ef8e6eb => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:17.889617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:17.989443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce8369-53d6-4861-a6b4-b1c0d75ba138 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:18.023262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b91e1-ad5d-4782-8a38-2beaabda933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:18.024131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b91e1-ad5d-4782-8a38-2beaabda933f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:18.024409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b91e1-ad5d-4782-8a38-2beaabda933f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:18.024684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b91e1-ad5d-4782-8a38-2beaabda933f None admin] PATH_INFO: `/v3/groups/41d754e00f7a4713af3f618577efd16d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:18.025896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b91e1-ad5d-4782-8a38-2beaabda933f None admin] RBAC: Authorizing `identity:get_group(group_id=41d754e00f7a4713af3f618577efd16d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:18.027737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b91e1-ad5d-4782-8a38-2beaabda933f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:18.029405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 236/454] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Apr 11 12:59:17 2022] GET /identity/v3/groups/41d754e00f7a4713af3f618577efd16d => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:18.035307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:18.134040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446094f2-e8ef-48fb-a579-091ec5b6980b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:18.166493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:18.167139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:18.167416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:18.168354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:18.169068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] RBAC: Adding query filter params (group.id=41d754e00f7a4713af3f618577efd16d, role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=1a113afb28034953938db4779ef8e6eb) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:18.169378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:18.170825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2d25-93d2-49bc-90d8-71a2897c8b59 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:18.176726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 219/455] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Apr 11 12:59:18 2022] GET /identity/v3/role_assignments?group.id=41d754e00f7a4713af3f618577efd16d&scope.project.id=1a113afb28034953938db4779ef8e6eb&role.id=278a0b419dab4b198abcf738011cdca6 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:21.080984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12dac-ff34-4028-aa61-90ceceee510f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.081494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12dac-ff34-4028-aa61-90ceceee510f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.081568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf12dac-ff34-4028-aa61-90ceceee510f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.083095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 237/456] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:21.088255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78364d-f73c-4e55-bc41-ecd1ee33704f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.088693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78364d-f73c-4e55-bc41-ecd1ee33704f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.088909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78364d-f73c-4e55-bc41-ecd1ee33704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.111099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7b78364d-f73c-4e55-bc41-ecd1ee33704f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:21.112271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7b78364d-f73c-4e55-bc41-ecd1ee33704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:21.203462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 220/457] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:21.245075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12dac-ff34-4028-aa61-90ceceee510f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:21.329363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03eac-b620-49c8-8b98-c40ac8fdbac7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.329645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03eac-b620-49c8-8b98-c40ac8fdbac7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.330082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03eac-b620-49c8-8b98-c40ac8fdbac7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.331681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 221/458] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:21.337856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ff30-2047-4121-a2d0-318894015809 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.338180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ff30-2047-4121-a2d0-318894015809 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.338469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171ff30-2047-4121-a2d0-318894015809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.366165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0171ff30-2047-4121-a2d0-318894015809 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:21.367565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0171ff30-2047-4121-a2d0-318894015809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:21.430877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf12dac-ff34-4028-aa61-90ceceee510f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:21.440103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 222/459] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:21.468006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ff30-2047-4121-a2d0-318894015809 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:21.498834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:21.499651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.499963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.500242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.518651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:21.520185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:21.538901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f3d8e934-d2f3-4935-9781-fbe66bcffd61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:21.540747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 238/460] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:21.547346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1ff5-39fe-4271-86ab-1dbaed467465 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.547979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1ff5-39fe-4271-86ab-1dbaed467465 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.548457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1ff5-39fe-4271-86ab-1dbaed467465 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.550324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 239/461] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:21.551307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1ff5-39fe-4271-86ab-1dbaed467465 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:21.589315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171ff30-2047-4121-a2d0-318894015809 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:21.642350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:21.643230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.643519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.643801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.657585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:21.660185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:21.666022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1ff5-39fe-4271-86ab-1dbaed467465 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:21.681174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8c9a7bff-d68c-420e-a70f-a0182c3bf130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:21.682468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 223/462] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:21.683841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.684124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.684556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.703437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:21.704901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:21.706699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:21.707523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.708540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.708872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.709601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:21.709906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:21.711293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960d5b-6046-433f-be63-b8e71eb8abd1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:21.723227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 240/463] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:21.728521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db545-3919-41fd-8258-b320670dbf92 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.728842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db545-3919-41fd-8258-b320670dbf92 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.729091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db545-3919-41fd-8258-b320670dbf92 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.730798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 241/464] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:21.732719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254db545-3919-41fd-8258-b320670dbf92 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:21.786136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 224/465] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:21.786136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:21.856298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254db545-3919-41fd-8258-b320670dbf92 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:21.882641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a9fed-a037-43f1-bc2d-c093d20925ea None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:21.890170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:21.891156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.891491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.891909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.892765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:21.893220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:21.894726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4372-9841-402b-aca4-fe874c12a1e1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:21.906870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 242/466] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:21.908261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.908546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.908816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.921828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:21.922750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:21.923168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:21.923580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:21.924420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:21.924732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:21.925924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:21.926431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:21.987802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 225/467] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:59:21 2022] POST /identity/v3/users => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:21.988893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.003770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 243/468] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:22.004944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.126802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32b29-71b3-4967-a636-91bc8b419717 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.141732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf094b9-8d76-43be-a1e2-4495f5be0665 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.164592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.165661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.166159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.166581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.179408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.180925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41aeb3-4bda-48bf-a4e1-8f4d65cd43bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.181296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.181611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41aeb3-4bda-48bf-a4e1-8f4d65cd43bf None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.181894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41aeb3-4bda-48bf-a4e1-8f4d65cd43bf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.182197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41aeb3-4bda-48bf-a4e1-8f4d65cd43bf None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.182913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41aeb3-4bda-48bf-a4e1-8f4d65cd43bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.185489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41aeb3-4bda-48bf-a4e1-8f4d65cd43bf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.204380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:22.205623 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 226/469] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:22.206625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.240080 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 244/470] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:59:22 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:22.241719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3974-7439-40b4-9fd9-fd25cc59e561 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.242278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3974-7439-40b4-9fd9-fd25cc59e561 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.242713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3974-7439-40b4-9fd9-fd25cc59e561 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.244322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 245/471] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:22.245183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3974-7439-40b4-9fd9-fd25cc59e561 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.334795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4b5ea-4440-4b96-9109-665bb4ba9474 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.371503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3974-7439-40b4-9fd9-fd25cc59e561 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.372535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.373355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.373640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.373917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.391737 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.398931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.410127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.411070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.411600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.412039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.412951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:22.413412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.415073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.417243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-dfdce3a8-dbcc-49eb-ab13-9a4aef88f934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:22.419392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 227/472] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:22.425645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.425935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.426291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.431533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 246/473] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:22.432679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.449986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:22.450212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:22.534598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 228/474] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:22.535648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.567384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a833eda-6ebf-47a8-9043-c019e30aab20 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.604290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.605307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.605726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.610391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.611415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:22.611870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.613376 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.625758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 247/475] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:22.626804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.640549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bfc1b-150e-4edd-87f5-7628b6f62e50 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.674155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.674834 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.675120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.675525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.676229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.677679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.727846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af5fe-e2dc-4375-b23d-8473623b2653 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.761103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.762331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.762706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.762987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.763825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.765479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:22.799250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 229/476] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:59:22 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:22.800338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.816157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.sql.core [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 11 12:59:22.816157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 11 12:59:22.816157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [parameters: {'id': '11970bfeae3c432cb36aff79f75e8b6f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 11 12:59:22.816157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80226) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 12:59:22.845195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 11 12:59:22.847371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 248/477] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Apr 11 12:59:22 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:22.853188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:22.920742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaf832-dcb1-4ab1-a863-143a71e5602a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:22.956342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:22.957027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:22.957310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:22.957580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:22.958344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:22.959837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:23.032206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb81e3-107c-42b0-a9d9-39d1c6571e01 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:23.050665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 230/478] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:59:22 2022] POST /identity/v3/users => generated 249 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:23.078571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c38be-0117-42ae-ac50-a6499b025f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:23.079414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c38be-0117-42ae-ac50-a6499b025f2d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:23.079696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c38be-0117-42ae-ac50-a6499b025f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:23.080014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c38be-0117-42ae-ac50-a6499b025f2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:23.092878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c38be-0117-42ae-ac50-a6499b025f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:23.101059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-953c38be-0117-42ae-ac50-a6499b025f2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 12:59:23.102698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 249/479] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 12:59:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:23.109464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:23.233951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ba5c7-cded-40f9-99e1-d9a8a2a125f4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:23.270503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:23.271192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:23.271475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:23.271756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:23.272533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:23.272839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:23.274308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85898-2186-4dc6-9bee-b1ee8b5b408a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:23.284245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 231/480] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:24.610948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b288b6-a97f-49ca-8865-48fd8207bddc None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:24.611477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b288b6-a97f-49ca-8865-48fd8207bddc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:24.611477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b288b6-a97f-49ca-8865-48fd8207bddc None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:24.613246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 250/481] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:24.618014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:24.618449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:24.618629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:24.638711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:24.639816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:24.719515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 232/482] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:24.757464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b288b6-a97f-49ca-8865-48fd8207bddc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:24.890204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b288b6-a97f-49ca-8865-48fd8207bddc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:24.926989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:24.927794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:24.928076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:24.928350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:24.939155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:24.946218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:24.947779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 251/483] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:24.953319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.137869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159da843-52f7-446d-a8ff-b17f360fec82 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:25.183983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:25.184586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.184870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.185149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.185918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:25.186248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:25.187629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c30d7a-effd-4043-a6b7-5214d892d90b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:25.202385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 233/484] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:25.207830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.226821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b5e7-d3ad-4fec-92d3-644de00126c0 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.227110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b5e7-d3ad-4fec-92d3-644de00126c0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.227392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b5e7-d3ad-4fec-92d3-644de00126c0 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.229972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 234/485] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:25.243686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.243974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.244258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.279296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:25.280537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:25.328968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351a66-722c-45a9-8a12-ec1a30074754 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:25.370889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:25.372116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.372594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.373058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.385047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:25.387460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:25.406516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:25.408367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 252/486] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:25.419451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.450859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 235/487] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:25.498139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.608556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a1581-5c0c-420e-97e9-9f0e80d81696 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:25.624236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf59ea-d3da-492c-9b10-cc574036f6a2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:25.667095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:25.668032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.668281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.668564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.669305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:25.669614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:25.671000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:25.672809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:25.673678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.673961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.674259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.694588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:25.700931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 253/488] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:25.703954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:25.706154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.712525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 236/489] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:25.713439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.829100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f0533-4052-40ed-acd6-aec6a478c2b6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:25.838604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cea9b-9de6-4ff8-9ee0-ecf6f3d2f6b3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:25.864999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:25.866465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.868213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.868499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.875646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:25.876610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.877085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.877564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.878560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:25.878675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:25.879162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:25.880467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:25.881001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d9cf-769d-4246-a527-40ce0bdb242a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:25.889900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 237/490] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:25.891599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbb86-e4d9-4a40-b2f4-54eaad851552 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.892079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbb86-e4d9-4a40-b2f4-54eaad851552 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.892554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbb86-e4d9-4a40-b2f4-54eaad851552 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.897999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e87cf912-fccc-4e15-aa37-2b927d861d24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 12:59:25.898500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 238/491] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:25.898868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 254/492] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 12:59:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:25.899741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbb86-e4d9-4a40-b2f4-54eaad851552 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:25.900124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:25.900415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:25.900693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:25.923669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:25.924907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:26.010437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 255/493] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:26.012208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.021823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbb86-e4d9-4a40-b2f4-54eaad851552 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.057287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.058560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.059108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.059579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.069551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.071337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.090312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-360ae417-c2ae-422a-b237-ed733ebe19fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:26.091744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 239/494] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:26.092948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842129a-09f9-4f2e-bbb4-188eeafb812b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.093228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842129a-09f9-4f2e-bbb4-188eeafb812b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.093500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842129a-09f9-4f2e-bbb4-188eeafb812b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.096835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 240/495] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:26.096835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842129a-09f9-4f2e-bbb4-188eeafb812b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.115975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a167b-1959-4db5-9097-82d560f8d43a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.149400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.150237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.150521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.150796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.151634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:26.152592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.154031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.190821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 256/496] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:26.191677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.209189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842129a-09f9-4f2e-bbb4-188eeafb812b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.244549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ef74d-7552-44de-a2c6-36c4232b0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.245347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ef74d-7552-44de-a2c6-36c4232b0c8f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.245631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ef74d-7552-44de-a2c6-36c4232b0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.245894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ef74d-7552-44de-a2c6-36c4232b0c8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.255805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ef74d-7552-44de-a2c6-36c4232b0c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:26.264041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-cb3ef74d-7552-44de-a2c6-36c4232b0c8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:26.269587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 241/497] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:26.269587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.269587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.269587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.283287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:26.284452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:26.305354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ea5fa-228e-44d3-ae10-2d662b3303e7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.369951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.371157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.371649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.371950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.372674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:26.372981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.374370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.387656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 257/498] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:26.388491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.402977 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 242/499] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:26.403811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.489408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688feebf-bd04-445b-a856-104d0ec85861 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.499160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55fbf-46a7-460a-825c-737efe426c2f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.522675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.523322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.523603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.523873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.532985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.533651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.533940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.534252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.535004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:26.535309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.536679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709ee37-da65-4688-9fd4-d00b2214393d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.544477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 243/500] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:26.545940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3832a2-7048-4849-897c-34fc288d418f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.546066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3832a2-7048-4849-897c-34fc288d418f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.546388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3832a2-7048-4849-897c-34fc288d418f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.547535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 244/501] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:26.548195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3832a2-7048-4849-897c-34fc288d418f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.589804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.591298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.646408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3832a2-7048-4849-897c-34fc288d418f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.678681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.679469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.679752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.680028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.684920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 258/502] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:26.685764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.687984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.689436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.702725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 12:59:26.703915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 245/503] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:26.704674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.778580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6858f4-4070-4b1e-a95b-80d378eef566 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.797292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e569334-68f7-42fa-9f4a-6ef3727f1ab2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.810062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76425025-3cc0-4aa7-963b-f675e31c85d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.810881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425025-3cc0-4aa7-963b-f675e31c85d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.811163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425025-3cc0-4aa7-963b-f675e31c85d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.811430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76425025-3cc0-4aa7-963b-f675e31c85d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.820983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76425025-3cc0-4aa7-963b-f675e31c85d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:26.828722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-76425025-3cc0-4aa7-963b-f675e31c85d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:26.829464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:26.829910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 259/504] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:26.830279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.830565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.830826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.831095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:26.831383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:26.831660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:26.841239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:26.842728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:26.848808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:26.850280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:26.859444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:26.860629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 246/505] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:26.861385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.918397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 260/506] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:26.930293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:26.967648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd610b-cf88-4637-b63a-3b63630e694f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:26.999882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.000661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.000944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.001220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.011232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.012626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec198-0548-4c9f-ab52-58dc870c2a1b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.012837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.028935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:27.030055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 247/507] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:27.030840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.044862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.045530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.045811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.046085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.046948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:27.047253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.048676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.065414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 261/508] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Apr 11 12:59:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:27.066222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.124726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a84b58-732e-4a7e-8a4b-c41d6efc85a3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.155724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.156374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.156652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.156921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.157655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:27.157960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.159180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8fc36-1062-40c8-abd0-a192ed1cff58 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.159432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.166971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 248/509] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:27.168320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.191837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.192496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.192778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.193052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.193773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:27.194077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.195467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.206268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 262/510] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:27.207052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.263500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481c51a-b240-42df-ac47-313f282c7160 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.295457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.296166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.296444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.296711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.300765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165849b-451e-4501-aa31-0d16e8506da9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.307674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.310296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.326331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:27.327498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 249/511] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:27.328285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.359354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.360017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.360299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.360575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.361302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:27.361608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.363018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.374733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 263/512] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:27.375525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.422994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f5ce-a5cd-4fd2-a735-1a95abb6a8e1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.455044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.455686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.455967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.456264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.470632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253038e-4831-4a53-ae80-b32dac928d2e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.502992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.503780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.504063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.504339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.514408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.515857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.519887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.521321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.532327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:27.533782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 264/513] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:27.535088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.621349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 250/514] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:27.622433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.635908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a434d-8235-470e-988b-35beaef238f5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.668498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.669297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.669573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.669846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.676809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.678285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.692275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 12:59:27.693457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 265/515] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:27.694254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.721141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a60ba6-26f8-4331-bfe0-e0f7dd539b37 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.753890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.754576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.754855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.755126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.755847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:27.756151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.757543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.768622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 251/516] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:27.769429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.787435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86ff01-726c-4241-b287-181ab25d9df1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.820154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.821019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.821299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.821568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.828128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.829558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.842729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:27.843910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 266/517] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:27.844667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.863332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadd0d4-51a4-4de9-a360-bf240efe319f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.895782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.896355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.896631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.896901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.897613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:27.897912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.899304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:27.911310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 252/518] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:27.912092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:27.939843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0317ad-439c-4999-8274-0bc862b6dcc5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:27.972091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:27.972883 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:27.973167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:27.973440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:27.983893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:27.985347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.001677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:28.002894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 267/519] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:28.003646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.010946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544efe81-d901-48af-94da-d5438f51aef0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.044926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.045600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.045880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.046181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.047015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:28.047323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.048758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.085180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 253/520] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Apr 11 12:59:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:28.086004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.097988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f87f2c-f578-4060-9f2f-c1d250b297db None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.129921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.130877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.131160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.131429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.132121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.133543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.179499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981910b-61a2-4c95-97a0-232486680d56 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.210705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.211347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.211624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.211895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.212668 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:28.212969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.214487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.231884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 254/521] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:28.232653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.255402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 268/522] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:59:28 2022] POST /identity/v3/users => generated 247 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:28.256240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.336967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8691-c6a7-4179-b345-b2cfb194a221 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.363922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e06e2f-8855-4985-a20c-8332fce8a3b3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.373140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.373959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.374272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.374547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.386751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.388269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.402941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.403629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.403913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.404189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.404934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:28.405244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.405561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 12:59:28.406675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.411569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 255/523] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:28.411569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.424626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 269/524] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:28.424626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.523785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b87257-dd5b-4fed-b2e3-5cb9299c9ec4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.526181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aba62-b24d-476f-9d4f-b4e87e1ddd26 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.558871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.559518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.559802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.560076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.560912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=b02c83e7079e45e7b8ae4b49ac15f4d2) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:28.561009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.561224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.561549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.561828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.562098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.562704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.575437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 270/525] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/role_assignments?user.id=b02c83e7079e45e7b8ae4b49ac15f4d2&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:28.575437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.639546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.641069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.695823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3670-501d-4d04-b0a2-a8d9b2554ec3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.733805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.734522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.734812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.735091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.736459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:28.737053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.738773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.755265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 256/526] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:28.755265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.761284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 271/527] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:28.762700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.860334 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b644-5c67-4652-8094-a6e2d8593616 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.863443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb697f-7a02-4794-8ed6-9ba7806c5309 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:28.895050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.896459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.897022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.897451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:28.897726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.898291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:28.898590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:28.898857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:28.906656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.908373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.909678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:28.911178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:28.923182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:28.924920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 257/528] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:28.925918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:28.929178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:28.931268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 272/529] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:28.931594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.026078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e9aa-007d-4b5a-b93d-85dd8e6fd26f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.033956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635294f-4800-4754-b068-f06d906dfd7c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.060298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.061252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.061706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.062171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.069224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.070204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.070680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.071536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.072506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:29.073338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.076393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.099852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 273/530] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:29.100955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.138817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.140328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.219712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac52615-0fdd-4169-a5df-55a1c5f351f6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.247283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 258/531] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:29.248049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.268904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.274027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.274027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.274027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.274027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:29.274027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.274027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.285017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 274/532] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:29.286067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.355959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e670dd-0416-4e7a-8b69-9acba93f1287 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.403281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.403597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499fda8-a998-492c-911c-2450581dbd2d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.403682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.403919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.404143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.405149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=31782b5628be41e0a17c08dc6f2fa229) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:29.405459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.408707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.415027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 259/533] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/role_assignments?user.id=31782b5628be41e0a17c08dc6f2fa229&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:29.415997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.471023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.471857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.472135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.472405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.499079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.500554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.527855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:29.529613 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 275/534] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:29.535106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.535469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb9a5e-4bc9-4a7a-a509-5d4f93de1221 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.571929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.573148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.573624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.574847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.582658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.584465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.600280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:29.606456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 260/535] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:29.609188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.705034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251d9e-492c-4b4e-8c00-327110cca528 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.714991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84a9d-6bb4-4a2f-acb7-fc62dc5f82d3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.739786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.740461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.740749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.741216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.741729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:29.742027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.743429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.753664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.754769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.755276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.755746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.757217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:29.757461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 276/536] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:29.757952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.759782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.763434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.778221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 261/537] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:29.780542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.865264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85d40d-0d94-49e3-a133-80f824cb1c43 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.882494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d79c39-5a11-4f15-9a2e-84c0a3fedb9c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:29.899839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.900642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.901146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.901146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.907979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.909422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.919174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:29.920094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:29.920568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:29.921058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:29.922075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=ebd82c17696d4a258748cc70ebc8569a) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:29.922615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:29.923610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:29.924448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:29.925126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 277/538] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:29.930466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:29.936590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 262/539] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/role_assignments?user.id=ebd82c17696d4a258748cc70ebc8569a&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:30.039195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b692-d958-4cad-ac7c-96cc8e2ec915 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:30.074666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:30.075340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:30.075620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:30.075893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:30.076700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:30.077004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:30.078455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891bd5-efcf-45c7-975e-1ae0b43a2c2b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:30.092779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 278/540] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:30.098876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:30.227641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a35b2b-1a75-4b3b-8b58-b7e1797da9eb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:30.270305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:30.276555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:30.276555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:30.276555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:30.276555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=f59d1deb46094936b5572bb6c5aa2f1a) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:30.276555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:30.276555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24f1f-53a9-4edf-962d-54c002b0360d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:30.286600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 263/541] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:30 2022] GET /identity/v3/role_assignments?user.id=f59d1deb46094936b5572bb6c5aa2f1a&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:31.067043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8244d-e766-4e27-b4e5-7f87f047ebb9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.067660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8244d-e766-4e27-b4e5-7f87f047ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.067660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8244d-e766-4e27-b4e5-7f87f047ebb9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.069329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 279/542] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:31.074673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.075683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.076177 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.081291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac94b5-f2dc-4cda-a66e-a60a4174f336 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.081811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac94b5-f2dc-4cda-a66e-a60a4174f336 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.082421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac94b5-f2dc-4cda-a66e-a60a4174f336 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.086366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 280/543] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:31.092352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.092912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.093397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.109911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:31.111392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:31.123179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:31.124373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:31.221233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 281/544] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:31.228233 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 264/545] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:31.248053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:31.263175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:31.360249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463ad6-b102-4d04-bf0c-44abda8448c6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:31.397412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:31.402146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.402146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.402146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.416233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:31.423978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:31.425539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 282/546] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:31.435383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:31.443139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b46db-85d0-4535-84a0-2efc7c3f9f0b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:31.479540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:31.481507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.481932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.483126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.508529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:31.516476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:31.531882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 265/547] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:31.532949 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:31.619961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d7932-3e34-4ee4-b367-3ed74a8f60bd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:31.685478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68906500-d782-4020-a950-9f02df531164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:31.687557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68906500-d782-4020-a950-9f02df531164 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.688003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68906500-d782-4020-a950-9f02df531164 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.689283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68906500-d782-4020-a950-9f02df531164 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.690225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68906500-d782-4020-a950-9f02df531164 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:31.692160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68906500-d782-4020-a950-9f02df531164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:31.693693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68906500-d782-4020-a950-9f02df531164 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:31.711154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 283/548] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:31.718684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68906500-d782-4020-a950-9f02df531164 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:31.720673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550f1a-cdf6-4f0f-a4fd-cea01a1fa6d4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:31.763102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:31.764040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.764475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.764902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.765809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:31.766302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:31.767840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:31.776722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 266/549] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:31.782899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:31.897731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68906500-d782-4020-a950-9f02df531164 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:31.934910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:31.936039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:31.936480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:31.937057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:31.950042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:31.952030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:31.971194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:31.973402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 284/550] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:31.979643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.012086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eb37c-ab7e-4779-bc4f-b6ca74f89629 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.106066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512690a7-803e-4441-af43-e182b2fb0ef9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.111348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.112163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.112441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.112712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.143427 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.144928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.145199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.146137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.146571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.147020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.147985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:32.148442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.150081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.166443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 285/551] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:32.174274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.187451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:32.195827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 267/552] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:32.200443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.367930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3f2da-9c4b-403d-8432-6c544a175c2b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.390579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fbe64-8fc1-47c5-a14d-b6ce409a50b9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.425016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.425606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.425890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.426185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.427072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:32.427380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.428922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.442698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 268/553] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:32.448395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.476946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.477746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.478025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.478321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.491245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.492681 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.511947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 12:59:32.515061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 286/554] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:32.525004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.600690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4ea59-cf31-400e-9f1f-df41c9fb80ef None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.633412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.634594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.635068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.635524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.638000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7acfee-6130-426a-990a-c2289d46b937 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.643206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.644867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.660165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-a51327b6-d3c3-4116-ada1-bf907e165eb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 12:59:32.661661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 269/555] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:32.663176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbbbe4-169a-430f-bd38-738c19502770 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.663458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbbbe4-169a-430f-bd38-738c19502770 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.663730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbbbe4-169a-430f-bd38-738c19502770 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.665227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 270/556] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:32.666679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef578a12-5cca-4e66-9def-5661be2ac091 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.666967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef578a12-5cca-4e66-9def-5661be2ac091 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.667240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef578a12-5cca-4e66-9def-5661be2ac091 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.669252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 271/557] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:32.670094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef578a12-5cca-4e66-9def-5661be2ac091 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.682343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.682945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.683257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.683706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.684715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:32.685022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.686479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aa031-8fb2-45e9-b5d9-0f129c761275 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.708580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 287/558] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:32.708580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0579-9207-47d5-82ad-6b15bc48eb4e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.708580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0579-9207-47d5-82ad-6b15bc48eb4e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.708580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0579-9207-47d5-82ad-6b15bc48eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.723579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1e6c0579-9207-47d5-82ad-6b15bc48eb4e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:32.725034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1e6c0579-9207-47d5-82ad-6b15bc48eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:32.779616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef578a12-5cca-4e66-9def-5661be2ac091 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.795474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 288/559] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:32.797127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.797416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.797690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.816231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:32.817580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:32.833641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:32.836099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:32.836099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:32.836099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:32.836099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:32.836099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:32.837543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:32.856051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 272/560] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:32.857240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.889919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 289/561] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:32.890805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:32.973255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c38fab-713b-4f77-9f47-0a1211452492 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:32.997444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894047cb-e674-4d5a-aae9-2b58c64bee1c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.014253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.015052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.015332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.015602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.026308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.027921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.032396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.033192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.033468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.033737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.044533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:33.045144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:33.051056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 273/562] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.051056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.051761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:33.053062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 290/563] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.057865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.151165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ee04b-db87-4de0-94cd-9cedc4b38da1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.153102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77b06-7391-41e6-8b21-3b8a7cc7cba3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.185551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.185785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.186537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.186687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.186821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.187095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.187197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.187645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.196895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:33.203947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:33.205139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 291/564] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.205908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.252858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.254300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.300045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1f11-6a9f-4fc1-adc3-f2062e430436 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.351771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 274/565] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:33.352674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.352927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.353444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.353726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.353997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.354755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:33.355731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.357176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e8fb6-5b7f-44d5-99dd-3e3272848ddc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.368476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 292/566] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:33.369710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240faa9-e137-4933-98ec-1395ba0a3d6b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.369995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240faa9-e137-4933-98ec-1395ba0a3d6b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.370305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240faa9-e137-4933-98ec-1395ba0a3d6b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.371562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 293/567] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:33.372247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240faa9-e137-4933-98ec-1395ba0a3d6b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.447754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb4c6f-28a4-437b-a160-2658012eae7e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.468905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240faa9-e137-4933-98ec-1395ba0a3d6b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.481439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.482128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.482411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.482688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.483435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:33.483743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.485121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.492728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 275/568] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:33.493504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.501866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.502569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.502852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.503176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.504026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:33.504188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.505542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.514449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 294/569] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:33.515240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.593394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2249c-5d52-4334-becc-174bb927f80e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.608735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f1831-00ef-4ba6-a5fe-6f8b48e3a1f5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.625463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.626284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.626567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.626838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.636757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.638225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.640690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.641480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.641769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.642043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.648595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.650011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.654186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ae0aaf04-6559-4c68-8ddc-206c7efe78e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:33.655382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 276/570] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.656533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693423-39d9-42d6-883c-459c596609ed None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.656817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693423-39d9-42d6-883c-459c596609ed None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.657089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693423-39d9-42d6-883c-459c596609ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.663324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:33.664508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 295/571] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.665267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.674092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-37693423-39d9-42d6-883c-459c596609ed None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:33.675361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-37693423-39d9-42d6-883c-459c596609ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:33.739150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 277/572] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:33.739884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37693423-39d9-42d6-883c-459c596609ed None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.768554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5a5a2-7b55-4e66-a0f9-9178d9529b20 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.801068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.801863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.802173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.802455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.812627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.814060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.830478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:33.831663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 296/573] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.831754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37693423-39d9-42d6-883c-459c596609ed None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.832436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.864646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.865432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.865710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.865980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.876292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.877718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.894345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:33.895524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 278/574] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:33.896287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.930318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cd0ee-e7a6-4d1d-a374-ec30b55f65fb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:33.962522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b915-c61e-431e-9619-4c117485764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:33.963174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b915-c61e-431e-9619-4c117485764a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:33.963452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b915-c61e-431e-9619-4c117485764a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:33.963726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b915-c61e-431e-9619-4c117485764a None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:33.964542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b915-c61e-431e-9619-4c117485764a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:33.964845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b915-c61e-431e-9619-4c117485764a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:33.966212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b915-c61e-431e-9619-4c117485764a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:33.978148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 297/575] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:33.978148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b915-c61e-431e-9619-4c117485764a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:33.991051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f0cd-8838-4b9a-aa10-5d742f3caa20 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.024039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.024695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.024979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.025258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.026044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.026390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.028109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.043757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 279/576] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:34.043757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.071272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b915-c61e-431e-9619-4c117485764a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.105902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.106803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.107089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.107367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.117119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:34.124996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:34.126228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 298/577] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:34.126995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.137611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc60a3-a808-4df7-a405-8f045fe223f4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.169044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.169695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.169972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.170283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.170993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.171292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.172667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.184488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 280/578] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:34.185263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.221717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322ec01-6c14-447a-bb52-8499915e151b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.253686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.254373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.254658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.254933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.255660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.255967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.257327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.269492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 299/579] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:34.271197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.282251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea6bd-e3f2-4be0-b488-b92fa8807c17 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.313919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.314732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.315010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.315276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.321792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.323248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.336888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:34.338059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 281/580] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:34.338837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.365385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cbdd8-b8ab-4026-babe-e569b3f2c2b1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.398389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.399288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.399575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.399852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/b02c83e7079e45e7b8ae4b49ac15f4d2/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.414523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=b02c83e7079e45e7b8ae4b49ac15f4d2, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.415964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.433492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226eed-8b75-49c5-9f6d-fe2822ead52b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.466358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.467017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.467301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.467578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.468320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.468626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.469981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.477824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 282/581] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:34.478627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.485095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 300/582] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:34 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/b02c83e7079e45e7b8ae4b49ac15f4d2/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:34.497156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.594798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec27d3-329e-4a08-beb1-9b638bd10b6e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.604428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ef54-c8ea-445f-8c17-526d6a76f44b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.632714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.633245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.633534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.633813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.641722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.642636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.642911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.643185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.643382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.644861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.651160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.652682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.659531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 12:59:34.666075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 283/583] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:34.666075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.668398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 12:59:34.669652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 301/584] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:34.670541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.772033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78247-347a-4233-86f0-6cf8aebb8c27 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.775267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d38a9-fb21-48a3-9551-5856a5b964e2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.805479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.806312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.806597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.806873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.809617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.810306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.810594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.810871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.811665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.811976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.813421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.818034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.819549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.831036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 284/585] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:34.831036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.842133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:34.843404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 302/586] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:34.844191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:34.936960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fc355-240b-4808-9756-9da16320680b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.950956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd6c4e-28bd-41be-8758-264cddb8ad3d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:34.971338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.972006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.972289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.972565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.973398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.973705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.975565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.986027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:34.986727 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:34.987017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:34.987298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:34.988146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:34.988458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:34.989916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:34.992591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 285/587] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:34.993404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.016134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 303/588] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:35.016134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.094750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c3d9-0d3f-43b6-aaec-0b1ca888d20f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.109770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90cfab-fdb4-4aa6-b4af-72402c3b3ad2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.129196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.129863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.130167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.130448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.131282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=9d78c88153b34e0191d934a30bcb1f1f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:35.131591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.133015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.139732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 286/589] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:34 2022] GET /identity/v3/role_assignments?user.id=9d78c88153b34e0191d934a30bcb1f1f&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:35.140520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.152771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.154299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.154889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.155623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.156589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:35.157288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.159319 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.178291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 304/590] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:35.179346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.253017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7df8a-fa49-4c35-b9d3-2c36b972cd09 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.291912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.293280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.293779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.294075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a3d5-b178-43d8-89dc-53addb69c0e5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.294828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.307173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.309707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.329280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:35.331472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 287/591] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:35.332465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.337024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.337204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.337393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.337649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.351197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.352624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.372297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:35.378344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 305/592] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:35.379250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.453414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507897f-cec9-40d9-a1a8-0ff6fd3d48ee None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.483777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6249dd-5787-4040-89dd-a5034a952fbe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.499486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.500292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.500572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.500846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.511780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.514067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.524916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.525701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.526080 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.526475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.527895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:35.528295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.529779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.530188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 12:59:35.531887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 288/593] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:35.532800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.544601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 306/594] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:35.545981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.639298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d83e5-e6d3-4d27-a7e5-e8d9e5805b37 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.672674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327e081-9783-4a58-997b-a1f53a866d54 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.679078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.679870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.680245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.680651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.681890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:35.682341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.684357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.704754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 289/595] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:35.704754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.714069 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.715141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.715647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.716183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.717368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:35.717893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.719619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.738488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 307/596] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:35.739610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.810411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486c27e-0cf2-42bb-abdf-7c2d22ee0747 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.846812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.847965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.848450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.848926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.856925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.858664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.860806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33147ee8-0778-4a08-bf0a-981c7ecb0b50 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:35.872877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:35.874773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 290/597] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:35.875977 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.897552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:35.898440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:35.898720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:35.898989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:35.907324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:35.909274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:35.926741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:35.928898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 308/598] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:35.929905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:35.989326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020449f-914a-40a8-8685-4d6592873829 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.023670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.024514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.024836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.025109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.036169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.037668 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.055565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cec5b-81d4-4983-8562-a7b600547e25 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.057710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:36.059848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 291/599] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:36.060704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.094763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.095429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.095714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.095994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.096781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:36.097093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.098561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.115932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 309/600] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:36.116831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.161893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de92c4-ac1f-4d71-87c8-d054993ad31f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.195786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.196454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.196738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.197013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.197805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:36.198131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.199829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.212453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 292/601] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:36.213257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.215744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444426-6e36-40b2-bdfc-3f555ff04edf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.251129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.251798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.252078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.252356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.253087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:36.253395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.254815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.271274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 310/602] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:36.272154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.315399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b66f-3cb8-4c89-aedc-4bb475fad5e6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.351962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.352861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.353139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.353417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/31782b5628be41e0a17c08dc6f2fa229/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.369017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=31782b5628be41e0a17c08dc6f2fa229, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.371039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.374924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1531-d2b9-4794-aad0-cea24974898d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.412514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.413409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.413690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.413966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/ebd82c17696d4a258748cc70ebc8569a/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.429547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=ebd82c17696d4a258748cc70ebc8569a, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.431022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.446342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 293/603] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:36 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/31782b5628be41e0a17c08dc6f2fa229/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:36.446342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.513764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 311/604] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:36 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/ebd82c17696d4a258748cc70ebc8569a/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:36.583823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e384ae-eecd-41aa-86a3-df6c839e837e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.635502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.636882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.637157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.637432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.649540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.651206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.670514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:36.672062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 294/605] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:36.677646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.789310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bc837-fbb3-40cf-a782-f0e92d29fb4b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:36.827102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:36.827779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.828065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.828339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.829146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:36.829455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:36.830928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8ec5-1867-4f5b-b42b-ec5c07eb773c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:36.843822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 312/606] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:36.849657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:36.892453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16026-cb3f-4071-879c-8d1a75f64321 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.892785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16026-cb3f-4071-879c-8d1a75f64321 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.893021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16026-cb3f-4071-879c-8d1a75f64321 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.894714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 313/607] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:36.899570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:36.899852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:36.900129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:36.921347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:36.922564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:36.980035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566d4b-0696-498d-82f9-1b6096141fd7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:37.025187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:37.027963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.028342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.028617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/f59d1deb46094936b5572bb6c5aa2f1a/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.036448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 314/608] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:37.058697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=f59d1deb46094936b5572bb6c5aa2f1a, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:37.060367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:37.077660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:37.164817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 295/609] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:36 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/f59d1deb46094936b5572bb6c5aa2f1a/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:37.187198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21d46-ee14-4469-9505-eff6c1054f03 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:37.227184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:37.228009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.228289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.228565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.240822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:37.248333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:37.254229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 315/610] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:37.255783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:37.378150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963a362-3c2f-4d17-bdaa-7bc40a26de28 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:37.416158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:37.416733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.417009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.417279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.418241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:37.418626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:37.420003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:37.433619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 296/611] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:37.439137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:37.545571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3ecc2-1acb-4a75-9535-ed2abd6b3abb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:37.578780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:37.579574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.579853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.580122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.593010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:37.594541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:37.611737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5cb4081e-625e-4b84-93d6-26aab81e40cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:37.617233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 316/612] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:37.618454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:37.645609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1ee9e-23d5-4c91-8614-4f62a44cbe49 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.645912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1ee9e-23d5-4c91-8614-4f62a44cbe49 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.646199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1ee9e-23d5-4c91-8614-4f62a44cbe49 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.647836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 317/613] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:37.653792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.654079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.654380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.674349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:37.675445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:37.777742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b9009-96ce-4d8d-8d5d-8c9802084945 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:37.788809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 318/614] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:37.817460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:37.818154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:37.818444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:37.818719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:37.819457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:37.819763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:37.821131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:37.831121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:37.834527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 297/615] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:37.844968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:37.984906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b17e5c-4075-4117-ade1-578ef38cdba1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:37.993116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a421c3-aac1-4d09-a8ac-4b428265b28f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:38.027125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.028077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.028357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.028908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.037046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:38.038540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:38.054651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 12:59:38.056687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 298/616] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 12:59:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:38.062811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:38.086804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.087622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.087905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.088183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.114719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:38.122654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:38.130222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 319/617] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:38.131686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:38.171298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88fbda-e81d-43ff-a030-b501c2d1fbd8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:38.227665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.228338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.228615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.228885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.229725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:38.230767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:38.234557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:38.259192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 299/618] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:38.266429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:38.357070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d257ba-8025-4171-a3c7-593e1ddf1e78 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:38.377314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665fed-0239-4288-964d-932bbe501261 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:38.428013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.429486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.431124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.431623 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.454830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.455525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.455816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.456096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.456859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:38.457167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:38.458564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:38.476999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 320/619] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:38.491135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:38.514626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:38.516436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:38.625249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 300/620] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 12:59:38.630984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:38.710671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ee309-b15d-496f-8b3c-6c659d2a02be None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:38.766478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511541-4d7c-4e8b-9151-d7e6263a1bc3 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:38.778806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.779968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.780449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.780929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.802549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:38.804362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:38.826332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:38.827455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:38.827934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:38.828401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:38.830512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:38.842131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 321/621] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:38.844098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:38.844218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:38.845911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:38.869931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:38.873518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 301/622] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:38.878672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.019695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7b16-b27b-4c5a-81f4-b3a49134fec4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.060586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92312061-5d4e-4bb0-a725-13f4e61aa5ba None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.081223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.081900 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.082203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.082484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.083215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:39.083526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.084891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.106938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 322/623] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:39.111800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.124997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.125673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.125955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.126263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.126994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:39.127304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.128696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.145198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 302/624] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:39.152650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.280485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73211-ba37-4031-8aee-379f5321cc92 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.295632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2dfd2-32a3-42e9-98c6-192fa48cac28 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.314995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.315808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.316091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.316369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.323347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.325249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.332587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.333638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.334144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.334634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.340099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-e5eba1f9-b69c-4b7e-828f-68ede2551a92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:39.341789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 303/625] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:39.343253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289de56-167b-47cc-81a3-4f5c3eeabfa2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.343475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289de56-167b-47cc-81a3-4f5c3eeabfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.343763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289de56-167b-47cc-81a3-4f5c3eeabfa2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.344909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.348943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 304/626] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:39.348943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289de56-167b-47cc-81a3-4f5c3eeabfa2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.351028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.365918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-83ad1013-8049-487e-b0ae-b14d6ff2cc9b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 12:59:39.372902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 323/627] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:39.374509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.375012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.375655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.406033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:39.407618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:39.466081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289de56-167b-47cc-81a3-4f5c3eeabfa2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.507357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.507357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.507357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.507357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.507808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:39.507808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.507808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.508476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 324/628] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:39.510292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.519389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 305/629] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:39.525470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.624749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f537495-c160-498e-a7af-6f105b417a96 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.635499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db06774-35d9-41f6-acdb-8e4c24886675 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.659522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.660217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.660494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.660771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.661633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:39.661943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.663463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0908dc-2d33-4069-921c-b3d802b30050 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.672756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.673435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.673717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.673994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.674884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=b02c83e7079e45e7b8ae4b49ac15f4d2) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:39.675195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:39.676665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:39.683308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 306/630] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/role_assignments?user.id=b02c83e7079e45e7b8ae4b49ac15f4d2&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:39.684174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.694768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 325/631] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:39.694768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cef437-3162-40c7-88f9-dee505f6ab20 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.694768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cef437-3162-40c7-88f9-dee505f6ab20 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.694768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cef437-3162-40c7-88f9-dee505f6ab20 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.694768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 326/632] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:39.701738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.702029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.702337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.731499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:39.734340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:39.803862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e68805-c4c0-4e4c-8340-8e9b427e1f17 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.829315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 327/633] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:39.830625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.865780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.866557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.866840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.867114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:39.879899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:39.887795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:39.893781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 307/634] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:39.893781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:39.953820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de54a0-06d6-47e3-8663-ea20f3691174 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:39.995004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:39.996696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:39.997359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:39.997807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.010246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073812d-e9d0-4b3b-90f3-ea27cfdc61cc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.014142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.015313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.033843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:40.035602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 328/635] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:40.036393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.056390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.057189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.057473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.057747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.069698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:40.077136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:40.078559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 308/636] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:40.079182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.140702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21902f1-bdd6-485f-838e-38c2eb696a0b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.173832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.174536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.174809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.175093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.175951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:40.176261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.177628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c508f0c-94cd-4c98-8e38-8769a81f971a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.180457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e17e74-9c6b-454e-8d91-ba2502aab021 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.185831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 329/637] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:40.186957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a74e-9714-4602-920e-1f5182663771 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.187245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a74e-9714-4602-920e-1f5182663771 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.187520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0a74e-9714-4602-920e-1f5182663771 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.188757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 330/638] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:40.189447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0a74e-9714-4602-920e-1f5182663771 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.215944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.216584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.216866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.217142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.217862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:40.218197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.219562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.232318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 309/639] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:40.233139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.301321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0a74e-9714-4602-920e-1f5182663771 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.331605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae86570-559f-4495-8b93-6e1125319c28 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.333839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.334535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.334818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.335091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.335829 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:40.336142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.337477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6e59-8435-4131-9aaa-af01be9b88a7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.350091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 331/640] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:40.350091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.350091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.350091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.365626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.365888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:40.366451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.366786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.367064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.367156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:40.377695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.379139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.396049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:40.401125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 310/641] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:40.401125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.457168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 332/642] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:40.457168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.507708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb41b0-da1d-44c1-aaa1-ab4ed53d87cb None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.540518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.541335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.541614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.541885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.549085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.550577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.563696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95f70-c797-412d-afe5-b7e0160c7b63 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.565780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:40.567018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 311/643] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:40.567779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.597519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.598715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.599174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.599644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.610030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.611714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.629029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:40.630799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 333/644] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:40.631771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.669035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c45c-613d-464c-9b5b-c010b69a483a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.703034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.703920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.704339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.704792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.705515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:40.705818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.707406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.719030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 312/645] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:40.719838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.738974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96abeb8-2750-48e2-84ef-9856d56457d3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.772612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.773405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.773685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.774288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.785395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:40.794368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:40.800630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 334/646] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:40.800630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.819618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaafc5-253e-4e05-9fc4-a6b84ce59c74 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.852854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.853519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.853799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.854072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.854944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:40.855257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.856822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.868703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 313/647] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:40.869517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.907313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32917bdf-acaf-4821-a0d3-98c397902a56 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:40.940592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:40.941189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:40.941470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:40.941745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:40.942519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:40.942839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:40.944207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:40.957187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 335/648] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:40.957870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:40.973351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b6752-9327-42e9-bb35-b13acb65480f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.008096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.008894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.009178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.009691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.016461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.017894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.031526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 12:59:41.037439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 314/649] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:41.037439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.060107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeea5e-3977-4271-8429-654a54d48127 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.093261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.093937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.094268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.094546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.095321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:41.095626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.096983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.105849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 336/650] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:41.106306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.141655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a5897-1e3f-48a2-b968-83ab1d1ae8e8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.175085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.176372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.176841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.177294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/9d78c88153b34e0191d934a30bcb1f1f/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.191436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=9d78c88153b34e0191d934a30bcb1f1f, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.192888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.200857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8960a7-4a3a-44d9-998b-43ef1f9ab666 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.232905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.233690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.233971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.234276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.241364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.242833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.256318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 12:59:41.257500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 337/651] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:41.258280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.270063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 315/652] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:41 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/9d78c88153b34e0191d934a30bcb1f1f/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:41.271194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.369842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a65a1-e20a-4817-b2d2-104bc07fe7d9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.381258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9b81-49ca-446a-b90f-0de49f994f20 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.407227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.407916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.408195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.408468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.409321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:41.409626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.411318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.420528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.421625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.422060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.422502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.434253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.435984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.436269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 338/653] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:41.437313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.458081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:41.459921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 316/654] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:41.460893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.543941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ef7b-724d-49d2-931d-e52d9554bd53 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.576018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2aabec-759f-45c6-9515-a7988e1e2483 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.577778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.578530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.578813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.579088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.579923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:41.580226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.581642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.600488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 339/655] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:41.601492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.617142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.617963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.618396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.618679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.702051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda516b-ee3b-48c4-8785-cf4e6874759f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.704903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.706423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.746603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.748200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.748506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.748789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.749548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:41.749862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.751891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.769374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 340/656] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:41.770267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.826384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 317/657] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:41.827293 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:41.898917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0405-e92f-4ad5-a56d-9a46dc0bf985 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.931835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98bdab-e80e-4f81-8209-845cb46b0105 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:41.941862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.942849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.943161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.943441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.966786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:41.967694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:41.968038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:41.968376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:41.976180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:41.977742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:41.992733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 12:59:41.994118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 318/658] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:41.995043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.015987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.017398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.101421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012ce30-cf25-4f79-95f3-2cdeb7432d97 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.127160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 341/659] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:42.128122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.138633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.139565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.139912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.140248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.151223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.152993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.170615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:42.171945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 319/660] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:42.172876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.228332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fdb46-3e84-4baa-9a5c-99b49777bb6a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.262131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.262842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.263124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.263401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.264249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:42.264558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.266064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.283271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 342/661] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:42.284470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.293282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a118-5280-43dc-bc13-01b40035d188 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.327196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.327988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.328265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.328533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.338553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.340873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.358138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ae64dd31-cb80-4643-b6f0-5577f79efec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:42.363945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 320/662] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:42.363945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8662eb-9813-490f-a17e-dffc1837aac1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.363945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8662eb-9813-490f-a17e-dffc1837aac1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.363945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8662eb-9813-490f-a17e-dffc1837aac1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.363945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 321/663] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:42.363945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8662eb-9813-490f-a17e-dffc1837aac1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.404387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4d361-3178-4fcd-a62d-a367a01db382 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.441037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.441704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.441990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.442307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.443035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:42.443343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.444701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.456754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 343/664] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:42.457580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.472234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8662eb-9813-490f-a17e-dffc1837aac1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.507562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.508461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.508926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.509202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.556521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1268b-b6ac-42ec-b988-77d9d2c94d6b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.574796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.576531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.592268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.593488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.593972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.594501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.595424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:42.595949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.597488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805802-2e07-4416-add6-93e869e51c39 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.613573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 344/665] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:42.613573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.613573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.613573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.628365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:42.629529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:42.672396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 322/666] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:42.673228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.704348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 345/667] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:42.705476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.779186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5eb46-f5c7-4562-8a3c-6fc41e1124a7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.810925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab2543-c09f-4b12-b1ef-05a4f99a7368 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.811776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.812617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.812910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.813181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.819792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.821227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.834955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:42.840972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 323/668] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:42.840972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.849081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.850148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.850426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.850695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.857339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.858797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.872266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:42.878084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 346/669] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:42.878084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:42.934529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d488c-3dbc-4e37-a8ee-0ac0ffb97e08 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.966766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:42.967554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:42.967837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:42.968107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:42.979106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:42.979475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ac81-21e4-4233-acda-c261647b5793 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:42.981019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:42.997661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:43.003602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 324/670] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:43.003602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.018370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.019172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.019455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.019730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.029917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:43.036821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:43.043055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 347/671] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:43.043055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.102679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50000c8-1387-47c4-9934-9c0320833da7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.135740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.136547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.136873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.137083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.137861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.138187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.139605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.143897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff81e-c053-420b-be01-e9d082f99ecf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.155645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 325/672] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.156769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.178525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.179179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.179458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.179729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.180506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.180815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.182602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.194545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 348/673] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.195620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.253465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6315c-d88b-4dad-9d0a-c27b41980402 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.287434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.288094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.288374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.288648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.289383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.289687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.291149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.296585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126999ba-e2f2-4bb3-9526-2ffe1391c5b0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.304317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 326/674] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.305576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.333690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.334387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.334674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.334945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.335690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.335984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.337325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.345439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 349/675] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.346264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.406270 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495ec73-5c80-4b42-9fd4-7490a0ebb49d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.440677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.441366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.441699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.441974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.442971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=31782b5628be41e0a17c08dc6f2fa229) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.443146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.444550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.448492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c59c1-30ce-41a5-b387-b67482b61b50 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.461778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 327/676] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/role_assignments?user.id=31782b5628be41e0a17c08dc6f2fa229&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.461778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.487156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.487835 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.488120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.488395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.489245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=ebd82c17696d4a258748cc70ebc8569a) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.489563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.491039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.498372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 350/677] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/role_assignments?user.id=ebd82c17696d4a258748cc70ebc8569a&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.499245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.601479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7b3f6-c1ed-4353-b1b0-560f4554c59b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.609858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7be64-b066-4a30-a28f-41bc04d3560c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.638934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.639696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.639974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.640248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.647853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.648197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.648666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.648950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.649226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.649644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.661205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.662805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.664839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:43.670341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 328/678] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:43.672504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.681002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:43.682606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 351/679] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:43.688871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.802552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7a0f-1da6-4264-a5e8-fb7d929e0c78 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.809864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3b56a-fe80-42f0-914f-8ba7cb7e06eb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:43.852508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.853175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.853464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.853731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.854574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.854698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:43.855685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.855856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.856117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.856394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.857117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:43.857417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:43.859762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880598bc-416b-469f-883f-c3eeb18cc95f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.860574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:43.873549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 352/680] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:43.874372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 329/681] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:43.879007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.879499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef85d-32d7-4a65-8ea3-beeabec5d1c4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:43.879790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef85d-32d7-4a65-8ea3-beeabec5d1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:43.880432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef85d-32d7-4a65-8ea3-beeabec5d1c4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:43.881642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 353/682] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:43.882506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef85d-32d7-4a65-8ea3-beeabec5d1c4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:43.995957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef85d-32d7-4a65-8ea3-beeabec5d1c4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:44.008924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240634a4-e507-41e0-a6ae-3c661a8513af None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:44.033211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:44.034232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.034694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.035146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.036160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=f59d1deb46094936b5572bb6c5aa2f1a) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:44.036650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:44.038377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13580bc4-faa5-449f-a388-8f50a168174a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:44.045987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 354/683] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/role_assignments?user.id=f59d1deb46094936b5572bb6c5aa2f1a&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:44.047537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.048039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.048502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:44.048645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.049302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.049585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.049859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.061003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:44.063262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:44.071435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:44.072908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:44.082703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 12:59:44.085295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 330/684] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 12:59:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:44.096973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:44.170758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 355/685] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:44.236809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:44.286435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e7e9-d16d-4d52-ae00-14fc87b36183 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:44.324501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:44.330221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.330221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.330221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.330221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:44.330221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:44.330221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:44.349561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 331/686] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 12:59:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:44.354983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:44.379920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55669-33d7-4a94-b944-c4bef6d33180 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:44.426133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:44.426133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.426133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.426133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.435106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:44.450893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:44.452478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 356/687] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:44.463190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12be91-30bc-4060-9d04-a2a701d687e0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:44.469395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:44.504881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:44.505542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.505824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.506099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.696726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39f2c-241d-4678-927d-ed0ccd4122d3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:44.720798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:44.722290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:44.794636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:44.795344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:44.795629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:44.795908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:44.796675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:44.796986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:44.798398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:44.821762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 357/688] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:44.831765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:44.953980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 332/689] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:44.960116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.057881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d99cac-8ae1-473f-86c8-a06650941b2b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.071978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b04bf-65c7-412f-97d4-10bd38444daa None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.102016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.102902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.103193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.103468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.108160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.108953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.109232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.109506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.115074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.116502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.130084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.131592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.133481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:45.139696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 358/690] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:45.140929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.162024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:45.170556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 333/691] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:45.175827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.252083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449409d8-c0a3-4deb-b7be-ed3f968f3235 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.308839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2f05-d069-4ea5-9961-345fd62d272d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.316648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.317711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.319849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.320320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.321237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:45.321719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.323311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.336163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 359/692] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:45.341919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.379755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.380767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.381221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.381665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.382583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:45.383060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.384624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.413040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 334/693] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:45.419210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.493075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87296-adb9-4a11-b99c-a655de6d267b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.527684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.528545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.528824 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.529098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.536494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.537923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.552528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 12:59:45.554047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 360/694] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:45.560713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.637505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa1355-2237-4529-9777-7ec84d1f53a4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.674716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5daa-57f6-40b3-91ed-ff046517c6a3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.719881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15598db-0682-4388-8250-6601acca885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.720696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15598db-0682-4388-8250-6601acca885d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.720982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15598db-0682-4388-8250-6601acca885d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.721506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15598db-0682-4388-8250-6601acca885d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.724283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.725229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.725510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.725780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.726660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:45.726967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.728629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15598db-0682-4388-8250-6601acca885d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.728729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.730083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15598db-0682-4388-8250-6601acca885d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.761864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f15598db-0682-4388-8250-6601acca885d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:45.764470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 335/695] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:45.770396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 361/696] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:45.772693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15598db-0682-4388-8250-6601acca885d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.776061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:45.906927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15598db-0682-4388-8250-6601acca885d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.950598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:45.951259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:45.951536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:45.951806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:45.952593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:45.952897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:45.954341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:45.975189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424a60-35a2-4495-bc7d-74a1807dceb2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:45.980052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 336/697] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:45.985528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.013634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.015957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.017103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.017751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.136236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.138050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.177985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455592b-f2c5-414f-889e-41ac413e3a89 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:46.243408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.244075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.244354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.244627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.245866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=b02c83e7079e45e7b8ae4b49ac15f4d2) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:46.246343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.247788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a2ce-02ba-4b32-89c4-4b86b57a153c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.253866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 337/698] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/role_assignments?user.id=b02c83e7079e45e7b8ae4b49ac15f4d2&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:46.255309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983131-064b-403b-beeb-279cdd1c0e72 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.255597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983131-064b-403b-beeb-279cdd1c0e72 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.255872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983131-064b-403b-beeb-279cdd1c0e72 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.261868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 338/699] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:46.264933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.265436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.265781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.271240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 362/700] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 12:59:46.279233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.289728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:46.290952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:46.399880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 339/701] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:46.435876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.454688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83d661-edbc-49fe-8cff-514c9252ec5a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:46.497870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.499069 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.499553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.500029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.513759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.515777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.533741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-4829bb34-d398-4639-ac31-8ee75ccb998e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:46.535522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 363/702] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:46.536897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8246af-e319-498e-9d01-33322dc05c39 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.537325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8246af-e319-498e-9d01-33322dc05c39 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.537743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8246af-e319-498e-9d01-33322dc05c39 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.539426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 364/703] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:46.540492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8246af-e319-498e-9d01-33322dc05c39 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.592201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76b635-b888-454b-9d6f-9626495ee351 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:46.627674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.628837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.629341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.629756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.630601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.632204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.647104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-67e9ab5c-d4f2-4674-b33c-eb6268417720 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 12:59:46.648973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 340/704] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:46.650643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.651078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.651495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.657104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8246af-e319-498e-9d01-33322dc05c39 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:46.673932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:46.676203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:46.699372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.700313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.700750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.701184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.702253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:46.702705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.704254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.717284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 365/705] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:46.718425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.755004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 341/706] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:46.756536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.822226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca681e0-4d80-480a-a072-d4cf7b118f37 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:46.856979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.857941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.858483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.858898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.859761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:46.860208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.861735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.866839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 366/707] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:46.867903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.878060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b414d-fc26-4418-9033-237bb1e2ab90 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:46.912608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:46.913419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:46.914468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:46.914773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:46.922907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:46.924974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:46.941216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:46.944321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 342/708] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:46.945265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:46.996406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b942-5fd5-4005-b38e-f692195b0290 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.037521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.039101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.039607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.040384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.053838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.055700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.063065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f5070-fe4c-4bcd-a4dc-56a2d5504a28 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.071948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:47.073173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 367/709] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:47.075365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:47.097323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.098361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.098361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.100201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.100201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:47.100201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.101367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33f6e5-a5f7-4c25-bd3c-f6abf2f41b56 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.114264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 343/710] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Apr 11 12:59:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:47.114264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baeef6-813e-4306-ac40-84d401b3bad2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.114264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baeef6-813e-4306-ac40-84d401b3bad2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.114264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baeef6-813e-4306-ac40-84d401b3bad2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.114264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 344/711] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:47.114264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baeef6-813e-4306-ac40-84d401b3bad2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:47.207396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c2faf-37b3-4feb-93f9-b61dbb4e7f16 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.231919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baeef6-813e-4306-ac40-84d401b3bad2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.245649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.246845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.247352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.247827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.248856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:47.249368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.251085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7c832-a10b-4d34-a9f3-74c4f8ea90c7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.265219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 368/712] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:47.273967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.273967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.273967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.274272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.274272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.274272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.274272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.274518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:47.274518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.274518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.287673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:47.289070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:47.290191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 345/713] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:47.291183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:47.368895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 369/714] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:47.369744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:47.406565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf80c-06fe-440b-80ed-9efd6d54a2b1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.441276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.441945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.442273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.442550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.443386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=9d78c88153b34e0191d934a30bcb1f1f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:47.443697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.445129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.451920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 346/715] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:47 2022] GET /identity/v3/role_assignments?user.id=9d78c88153b34e0191d934a30bcb1f1f&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:47.452745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:47.549757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff4e9-d23a-49f5-9a00-09f22ed650f3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.617035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.617726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.618067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.618376 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.619149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.622302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.652500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438c6b-262b-4c61-b648-5f291d47ef7c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.689034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.689905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.690213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.690490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] PATH_INFO: `/v3/services/network` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.691158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.692595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.704753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 12:59:47.708609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 347/716] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:47 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:47.714837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 370/717] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 12:59:47 2022] POST /identity/v3/users => generated 254 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:47.718299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:47.837318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acbd9b-aeb3-44b1-804a-18cd748da07f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:47.875468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:47.876213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:47.876500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:47.876831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:47.877576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] RBAC: Adding query filter params (name=network) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:47.877886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:47.879384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02833ab-5adc-4ec5-95ab-d957699e2006 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:47.884868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 348/718] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 12:59:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:47.890948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:48.039099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806309b-d570-4713-b582-9e4650cbf18a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:48.074454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:48.075122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:48.075404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:48.075738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:48.076463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] RBAC: Adding query filter params (type=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:48.076771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:48.078168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2c052-ab2a-4713-a932-a34021f1a888 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:48.084014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 371/719] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 12:59:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:48.941681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715b8f-a737-4f8d-badc-b9ec3a09beed None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:48.942214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715b8f-a737-4f8d-badc-b9ec3a09beed None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:48.942289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715b8f-a737-4f8d-badc-b9ec3a09beed None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:48.943866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 349/720] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:48.949306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:48.949712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:48.949896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:48.967369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:48.968555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:49.036977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 372/721] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:49.060683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715b8f-a737-4f8d-badc-b9ec3a09beed None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:49.162962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715b8f-a737-4f8d-badc-b9ec3a09beed None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:49.196857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:49.197572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.197853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.198146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.209092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:49.216332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:49.217861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 350/722] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:49.223635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:49.328446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd418-cae6-4080-9bcd-71fbffb32afb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:49.363406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:49.364091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.364373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.364649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.365411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:49.365716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:49.367118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:49.376955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 373/723] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:49.383763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:49.486832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d359c-7a64-4cfc-a108-81eb20119015 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:49.521994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:49.522824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.523106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.523384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.535578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:49.537045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:49.553553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:49.555097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 351/724] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:49.561177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:49.662160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b94da-7079-405b-b07c-09afe4bdbde0 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:49.696495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:49.697165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.697447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.697723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.698529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:49.698980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:49.700493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564272-3b6f-4dbe-847c-8c59d1280990 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:49.712725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 374/725] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:49.718663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:49.819749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452bf33-26e8-46ee-90f5-b7e5eb209310 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:49.849234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629b49-a17d-4c96-aef5-6e0e5adf967a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.849585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629b49-a17d-4c96-aef5-6e0e5adf967a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.849780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f629b49-a17d-4c96-aef5-6e0e5adf967a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.852506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 375/726] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:49.858674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.858957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.859224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.861740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:49.862746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:49.863033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:49.863310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:49.878178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:49.878464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:49.879375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:49.879666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:49.903098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 12:59:49.910613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 352/727] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 12:59:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:49.917911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:49.960121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 376/728] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:49.987962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.098493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b716608-7bc9-4fbe-ae60-216bc27ef6e2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.138330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c69986-b850-4446-9b8d-14974c1ae995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.139010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c69986-b850-4446-9b8d-14974c1ae995 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.139292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c69986-b850-4446-9b8d-14974c1ae995 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.139569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c69986-b850-4446-9b8d-14974c1ae995 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.140321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c69986-b850-4446-9b8d-14974c1ae995 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:50.142443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c69986-b850-4446-9b8d-14974c1ae995 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:50.144290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95214-81e7-4313-a17e-ace93fb96332 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.187384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.188384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.188878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.189362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.190487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:50.191027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:50.192778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:50.211702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 353/729] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 12:59:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:50.220045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.267894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 377/730] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 12:59:49 2022] POST /identity/v3/services => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 12:59:50.345097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e11a8-89b9-479b-aa7e-0683cce7c11a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.376217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591c5c-86da-4c7a-a921-b0e158cf3dcd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.376490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591c5c-86da-4c7a-a921-b0e158cf3dcd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.376700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591c5c-86da-4c7a-a921-b0e158cf3dcd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.378651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 378/731] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 12:59:50.383959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.384239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.384527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.407122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.408012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.409315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.409676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.422055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:50.423295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:50.423562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:50.424521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:50.445144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:50.446783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 354/732] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:50.455230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.582271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 379/733] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 12:59:50.607538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.612103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef711-6ac1-425c-939a-ea1920c4920d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.651195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.652731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.652999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.653281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.654009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:50.654335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:50.655726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:50.669377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 355/734] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:50.676278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.748044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe11e-f34c-46c4-b282-07ecc9bae8c4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.779310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b5a6-964c-4293-bf8f-1f6030cc1bde None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.814939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.815743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.816027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.816303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.824013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:50.825704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:50.832339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.833169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.833454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.833730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.840421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:50.842142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 356/735] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:50.847979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.870878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:50.878376 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:50.880144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 380/736] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:50.903567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:50.959369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf101-fe9b-442f-9f58-64a177d805dc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:50.993703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:50.994414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:50.994751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:50.995035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:50.996218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:50.996534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:50.997978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.010795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 357/737] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:51.016945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.044979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c189c3-18dc-4e56-bf1e-593d00713865 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.088526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.089262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.090048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.090373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.091125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:51.091437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.092838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048d95f-17e8-4725-a1ce-32be60423bae None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.101634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 381/738] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:51.102917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab77d9e-009f-4186-a319-e90d7fa07233 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.103276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab77d9e-009f-4186-a319-e90d7fa07233 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.103626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab77d9e-009f-4186-a319-e90d7fa07233 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.109331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 382/739] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:51.109331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab77d9e-009f-4186-a319-e90d7fa07233 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.166078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1daa9-e19a-4256-8f3a-b820be6b60e4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.202409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.203716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.204237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.204709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/b02c83e7079e45e7b8ae4b49ac15f4d2/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.206929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=b02c83e7079e45e7b8ae4b49ac15f4d2, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.208608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.217800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab77d9e-009f-4186-a319-e90d7fa07233 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.252170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.252977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.253256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.253609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.265474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.267002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.284605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-baafb3be-fbf3-42bd-89fc-1916d5b95696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:51.290149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 383/740] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:51.290149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e9ee-482b-4dd8-af96-6b61562bdbe7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.290149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e9ee-482b-4dd8-af96-6b61562bdbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.290149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e9ee-482b-4dd8-af96-6b61562bdbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.307532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1797e9ee-482b-4dd8-af96-6b61562bdbe7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:51.314205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1797e9ee-482b-4dd8-af96-6b61562bdbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:51.314738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 358/741] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:51 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/b02c83e7079e45e7b8ae4b49ac15f4d2/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 12:59:51.316869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.408338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 384/742] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:51.409929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec8d1-6bf1-4071-b474-7746d7913703 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.410138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec8d1-6bf1-4071-b474-7746d7913703 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.410421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ec8d1-6bf1-4071-b474-7746d7913703 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.416042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 385/743] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:51.417882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.418259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.418448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.436856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:51.438058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:51.457717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc98f9-bbce-4566-8da8-f1b89c7b41b8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.497802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.498866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.499348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.499881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.500841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:51.501351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.503039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.516978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 359/745] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:51.517700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 386/745] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 12:59:51.518535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.522028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.636858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da98ca-a7f2-466e-a92f-b4df992325f2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.640776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2765a-9c74-42a8-8b98-ffd6ba3b3b45 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.671269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.672046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.672327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.672664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.683090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:51.683949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.684990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.685463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.685952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.690293 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:51.694212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.695938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.696484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 360/746] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:51.697253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.715466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 12:59:51.717785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 387/747] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:51.718872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.815574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457877-f34f-4367-bb35-a89abcae9a2f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.833185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5991f-331f-4318-bfcf-baf3f37d891d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:51.849703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.850670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.850954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.851513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.851951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.853320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.872196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:51.883201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:51.883201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:51.883201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:51.883201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:51.883201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:51.883201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:51.885882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 388/748] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:51.887661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:51.962902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 361/749] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 12:59:51 2022] POST /identity/v3/services => generated 240 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:51.964206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.021614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26560826-71f7-4f2f-b8b5-968bfb736001 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.123774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.124542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.124762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.125044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.125908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:52.129249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.130765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.169030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 389/750] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:52.174909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.179620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a3a5-91c9-40a7-9909-1a0d5797f807 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.218633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.219609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.219609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.219902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.235162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.236991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.257038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:52.258004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 362/751] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:52.267190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.292157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d89186-ea7b-4b2b-80fd-25dde1484154 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.342171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.344042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.344481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.344930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.376997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04b52a-fc0a-407d-9ceb-74c673bc5a58 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.422889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.423622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.424159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.424159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.424961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:52.425271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.426701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.432068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.434406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.443604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 363/752] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:52.444942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.545070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff99bf-ca44-4884-bb93-08e9aab7568b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.560436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 390/753] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 12:59:52.568207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.611692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.612818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.613277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.613755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.631154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.633964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.663287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 12:59:52.665190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 364/754] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:52.670860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.780947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a9b1e-0b1d-437f-9b96-979960b2e8d1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.818363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77de11-9016-458a-9fda-7a2d69272346 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:52.826889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.827570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.827850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.828121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.828964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:52.829273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.832422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.860171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 365/755] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:52.872346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:52.873339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:52.873763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:52.874238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:52.875111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:52.885187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:52.887488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:52.905061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:52.906898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 391/756] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:52.913140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.009864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e89ff-c9af-4e82-99fc-221e724e1184 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.047495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589a5f-65a7-4ce7-af59-9631d8aa007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.048542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589a5f-65a7-4ce7-af59-9631d8aa007b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.048963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589a5f-65a7-4ce7-af59-9631d8aa007b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.049407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589a5f-65a7-4ce7-af59-9631d8aa007b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.113182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72e0dc-bf97-4d75-b966-25562a6f6f40 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.131589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589a5f-65a7-4ce7-af59-9631d8aa007b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.133036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589a5f-65a7-4ce7-af59-9631d8aa007b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.158180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.158885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.159130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.159407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.160129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:53.160444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.161785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207acde-3454-4181-8c22-0fab2577837f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.174806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 392/757] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:53.176379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617146e-bab9-4129-9278-c09cea42ce55 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.176660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617146e-bab9-4129-9278-c09cea42ce55 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.176934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617146e-bab9-4129-9278-c09cea42ce55 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.182343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 393/758] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:53.182343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617146e-bab9-4129-9278-c09cea42ce55 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.263832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 366/759] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 12:59:53.265251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.274798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.274798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.282606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:53.283780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:53.286414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617146e-bab9-4129-9278-c09cea42ce55 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.322309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.323195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.323581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.323923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.330876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.332393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.346643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:53.348281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 394/760] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:53.349265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.366588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 367/761] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 12:59:53.366588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.486574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f175c36-3c40-41b5-90b3-ad27aeec2138 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.507667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e7c68-108e-455f-a8d1-60a0f2bdd1d1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.522349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.523392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.523539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.523698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.535771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.537338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.552418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.553418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.553912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.554414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.554638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:53.555596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:53.556125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.558345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.561505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 395/762] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:53.562132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.572311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 368/763] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:53.573086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.672619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd60bc-f39f-44ac-b56b-a70bd5c41412 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.687638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a821-7e77-4310-a511-577bb29e5453 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.705968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.706863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.707146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.707485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.708325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:53.708698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.710144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.722212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 369/764] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:53.726606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.731328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.733360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.733875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.734399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.735264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.736811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.754446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 12:59:53.761999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 396/765] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:53.761999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.832227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6c11-bd66-4988-9810-1d89ae3ff5bc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.866044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.866724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.866999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.867269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.868093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=9d78c88153b34e0191d934a30bcb1f1f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:53.868401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.869815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.876003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 370/766] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/role_assignments?user.id=9d78c88153b34e0191d934a30bcb1f1f&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:53.876806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:53.897238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f7c69-5eb0-449b-936c-b9386946b25b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:53.944582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:53.945385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.945671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.945947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.954293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:53.955762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:53.972418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-9b9e3e31-4bb6-4acd-8a64-cc5dbf79ebb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:53.978236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 397/767] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:53.978236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959ed0-7d1e-432e-919f-ec34d4887585 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.978236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959ed0-7d1e-432e-919f-ec34d4887585 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.978236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959ed0-7d1e-432e-919f-ec34d4887585 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:53.982558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 398/768] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:53.984286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:53.984433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:53.984692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.002462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:54.003057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b909e5-4664-43bd-a56b-e16f44b611f5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.003668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:54.045772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.046484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.046767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.047043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.047932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:54.048072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.049789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.054492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 371/769] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Apr 11 12:59:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.055322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.090658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 399/770] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 12:59:54.091918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.185487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aaabd-1ee1-42b0-b568-510589b3414c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.221781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.222410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.222693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.222965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.223760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:54.224070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.225765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.227278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad372f-da7b-4175-90d4-66a12c5cf059 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.242142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 372/771] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.242142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.269074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.278507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.278507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.278507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.278507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:54.278507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.278507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.279821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 400/772] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.280970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.340701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1ceb-9a5b-4b0a-a1d7-27f314656c3c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.378908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.382539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.382539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.382539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.392853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200f92a-e4fe-43db-b18b-d044c08561c2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.393415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:54.405920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:54.412043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 373/773] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:54.412890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.429587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.430537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.430990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.431494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.432533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=140c9cd9be1945ef98619be5d3cc84cb) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:54.433058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.434730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.446258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 401/774] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/role_assignments?user.id=140c9cd9be1945ef98619be5d3cc84cb&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.447494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.518947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb456a-55f2-4d08-a429-ab3665733af5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.573057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.574282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.574598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.574872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.575727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] RBAC: Adding query filter params (interface=public, service_id=6ca9012d63fa423e995fbac9039b2cd8, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:54.576044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.577460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.594586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 374/775] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/endpoints?service_id=6ca9012d63fa423e995fbac9039b2cd8&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.599696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.664840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e9ddf-08dc-46df-9cf3-6e9b44cf5328 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.751428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.752110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.752397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.752677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.753441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:54.753752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.755138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc62d3-1220-4117-be71-7342e69143bd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.757391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006ee4-dd7f-47bd-87a8-8204ee33c017 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.772691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 402/776] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.774348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61940d-ee53-4698-b5f3-5a449cd5c1d7 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.774839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61940d-ee53-4698-b5f3-5a449cd5c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.775304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61940d-ee53-4698-b5f3-5a449cd5c1d7 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.777949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 403/777] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:54.778952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61940d-ee53-4698-b5f3-5a449cd5c1d7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:54.803006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314ded1-d282-4e8b-870e-754b38f4fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.804120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314ded1-d282-4e8b-870e-754b38f4fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.804600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314ded1-d282-4e8b-870e-754b38f4fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.805041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314ded1-d282-4e8b-870e-754b38f4fbc3 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.806520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314ded1-d282-4e8b-870e-754b38f4fbc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:54.809036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314ded1-d282-4e8b-870e-754b38f4fbc3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:54.816469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 375/778] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:54.818734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810202ae-338d-4994-999a-6893fc118397 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.819261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810202ae-338d-4994-999a-6893fc118397 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.819871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810202ae-338d-4994-999a-6893fc118397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:54.842372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-810202ae-338d-4994-999a-6893fc118397 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:54.844588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-810202ae-338d-4994-999a-6893fc118397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:54.926435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61940d-ee53-4698-b5f3-5a449cd5c1d7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:54.968990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 376/779] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 12:59:54.994508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:54.995841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:54.996132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:54.996411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.013130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.014658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.033299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:55.034841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 404/780] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:55.040084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810202ae-338d-4994-999a-6893fc118397 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.051064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.161642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810202ae-338d-4994-999a-6893fc118397 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.166757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270b5ee-1dda-46f5-8990-c3bdc84d6f59 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.197066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.198073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.198614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.199162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.200099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:55.200633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.202244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.202678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.203493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.203782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.204059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] PATH_INFO: `/v3/services/network` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.204854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.206361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.218075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 377/781] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:55.218277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 12:59:55.221820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 405/782] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:55.223929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.226564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.333939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b33b61-f8b9-482e-ae24-812dd1867478 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.351807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5fd1f-f2a3-40fd-9167-89f416814586 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.368120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.368927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.369211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.369489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.378244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.379734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.396042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 12:59:55.396042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 378/783] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:55.403475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.404832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.405677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.406199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.406839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.408593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] RBAC: Adding query filter params (name=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:55.409067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.410610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.422560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 406/784] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:55.428379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.553045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3cff-d7c1-4b8e-a8d5-4e04bb650c7c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.587717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.588316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.588605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.588884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.590543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] RBAC: Adding query filter params (type=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:55.590861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.594127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.597621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 407/785] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:55.603465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.625685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47696b1-02c0-4015-9961-703dbc47e7f4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.704603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b55b66-b856-41b8-83f5-64e238052c0d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.708212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.709193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.709669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.710197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.711285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:55.711785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.713404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.739886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.740563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.740880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.741175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.741978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] RBAC: Adding query filter params (interface=public, service_id=15aa96a8281d48ca8eaa06ee16138388, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:55.742315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.750130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.752367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 408/786] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/endpoints?service_id=15aa96a8281d48ca8eaa06ee16138388&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:55.754322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 379/787] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:55.757691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.759354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:55.912740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7b25b-114a-4a04-bd16-7a24bbc0eb8f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.934655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618000b-e902-4e08-94e8-edd54eb4d1df None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:55.963739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.964476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.964760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.965034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:55.965729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:55.967115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:55.979270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 409/788] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:55.998355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded1e0a-3e40-4653-a7f5-20d931568f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:55.999038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e0a-3e40-4653-a7f5-20d931568f68 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:55.999323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e0a-3e40-4653-a7f5-20d931568f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:55.999601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e0a-3e40-4653-a7f5-20d931568f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.110004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded1e0a-3e40-4653-a7f5-20d931568f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:56.111524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded1e0a-3e40-4653-a7f5-20d931568f68 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:56.235714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 380/789] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 12:59:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 12:59:56.239144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:56.357116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098a0d3-3a6a-4ab9-84a5-7df2f741372d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:56.409685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:56.410533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:56.410815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:56.411093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.422535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:56.423990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:56.449228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:56.449884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e101-8243-4fb5-828c-bf2750da8b96 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:56.451120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e101-8243-4fb5-828c-bf2750da8b96 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:56.451120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e101-8243-4fb5-828c-bf2750da8b96 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.452003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 381/791] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:56.452138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 410/791] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:56.457436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:56.457567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:56.457737 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:56.457999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.475034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:56.476486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:56.579176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 382/792] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 12:59:56.602196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:56.603246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367e78-3b07-42fe-b9c9-c36514caa4ce None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:56.663357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:56.664040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:56.664323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:56.664602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.665343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:56.665648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:56.673226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:56.690382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 411/793] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:56.697418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:56.784717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941e7b0-6301-44a9-95d6-84f135a88105 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:56.851506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:56.852674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:56.853146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:56.853626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.865339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:56.883899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 12:59:56.888076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 383/794] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:56.896564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4641a-5757-4279-ac3e-02051b54d36c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:56.899527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:56.976310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:56.978268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:56.978877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:56.980174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:56.988989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:56.990795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.011937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:57.013944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 412/795] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:57.020532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.122455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77312c37-68cf-4665-aed6-d4a9301483f7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.195434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103bcd5-6bcf-4e28-b395-625a522a553b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.217483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.218309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.218590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.218862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.219618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:57.220011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:57.221743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.242786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 384/796] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 12:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:57.252521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.273716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.274461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.274746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.275019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.275819 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:57.276124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:57.278593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.302608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 413/797] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:57.310043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.414094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433703b9-7376-4e5f-8476-c8599fd85ddc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.449747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c98c1-217c-4996-b24a-4222ff61e508 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.456502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.457777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.458272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.459117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.472472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:57.475075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.492863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.493820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.493989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d8f6f2d1-b9a4-4256-966e-bbc6b3b9ee7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:57.494431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.494865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.496196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=b02c83e7079e45e7b8ae4b49ac15f4d2) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:57.496755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:57.498513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9cb5-211d-4b31-b2d3-8719b81e1a82 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.500276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 385/798] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:57.501706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347e3b-ad41-4502-908f-a63cd531e442 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.502134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347e3b-ad41-4502-908f-a63cd531e442 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.502610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2347e3b-ad41-4502-908f-a63cd531e442 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.508225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 386/799] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:57.508225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347e3b-ad41-4502-908f-a63cd531e442 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.513132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 414/800] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/role_assignments?user.id=b02c83e7079e45e7b8ae4b49ac15f4d2&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:57.513383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.518162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.518162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.550155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:57.551382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:57.694408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 415/801] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 12:59:57.697759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2347e3b-ad41-4502-908f-a63cd531e442 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.741716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.742413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.742689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.742959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.743688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:57.743988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:57.746140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.755475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.758810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 387/802] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:57.766794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.886710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71afade-3cc5-4268-bcc3-3e618195c404 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.904927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06be42-84a9-4626-bf6b-f9c31baa9b5c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:57.924027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.925057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.925187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.925372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.933357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:57.935146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:57.947622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:57.948728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:57.949203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:57.949685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:57.950017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 12:59:57.951956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 388/803] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:57.957069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:57.962677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 12:59:57.971675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 12:59:57.978525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 416/804] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 12:59:57.981523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.068823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf7316-9ee1-4af4-9970-b9ca44c4f624 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.084512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c0836-1471-40fe-9a5b-7654dfbb9b46 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.104347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.105797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.106349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.106835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.107867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:58.108371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.110133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b88065-595e-4317-9b1f-36c989a4ff1c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.118572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.119240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.119603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.119774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.121108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:58.122142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.122793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.130778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 389/805] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 12:59:58.132492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4579da-51b8-45e0-bc88-20528a69d41d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.132993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4579da-51b8-45e0-bc88-20528a69d41d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.133459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4579da-51b8-45e0-bc88-20528a69d41d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.135251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 390/806] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:58.138251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 417/807] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 12:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:58.144958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.144958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.144958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.146604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.164310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:58.165983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:58.249028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606833-71c1-4c73-8aff-cb2356da0422 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.258191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 391/808] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 12:59:58.259305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.319771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.320709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.328201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.328201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.339807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.341667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.363505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:58.365235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 418/809] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:58.369970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.397063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd9ac-43ed-4e27-bf8b-b997fb9c2b53 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.440043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.440840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.441118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.441392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.454252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.456198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.473145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6db213-2837-47e8-ad88-52a8822a360e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.478067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:58.485014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 392/810] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:58.485895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.513286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.514473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.515014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.515480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.516389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.517958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.530277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 12:59:58.536862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 419/811] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:58.537930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.606239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc48f32-2cb5-4217-9cb8-4145e6455b18 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.643920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.644955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.645432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f426334-f947-4c51-9e5e-26da248110d4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.645541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.646031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.646973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:58.647530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.649094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.665957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 393/812] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:58.667283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.686739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.687938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.688701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.689218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.690181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:58.690713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.692969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.710565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 420/813] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:58.710565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.768547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8b487-5f72-4a09-938f-75a85b046593 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.801605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.802446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.802795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.803189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.803962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:58.804330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.805752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ee84-5de6-4988-9802-ac4423dad8d4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.807426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d0aa-b934-47b1-aa7e-04172e0f0df4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.815318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 394/814] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:58.816920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c862ce3-ea94-49c8-8e74-9e2180b65015 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.817268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c862ce3-ea94-49c8-8e74-9e2180b65015 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.817613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c862ce3-ea94-49c8-8e74-9e2180b65015 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.819145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 395/815] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 12:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 12:59:58.819755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c862ce3-ea94-49c8-8e74-9e2180b65015 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.845663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.846505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.846788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.847073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.854008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.855779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.868973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 12:59:58.875295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 421/816] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:58.875295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:58.927571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c862ce3-ea94-49c8-8e74-9e2180b65015 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.963371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:58.964361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.964646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.964918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:58.973516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804880-ca44-4ffd-be1a-6d0b5c415d13 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:58.973774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:58.975515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:58.989866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-451a76e4-fafa-4378-b320-2d477546652d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 12:59:58.996879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 396/817] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:58.996879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:58.996879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:58.996879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.009280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 12:59:59.010492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 12:59:59.010771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.011665 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.011980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.012317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.013095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:59.013407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.014789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.024113 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 422/818] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Apr 11 12:59:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:59.024113 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.076395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 397/819] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 12:59:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 12:59:59.082969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.129316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a180-3c78-4808-be91-6dd7def961a9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.162231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.162889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.163166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.163443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.164219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:59.164526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.165940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.183415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 423/820] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:59.183415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.183666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b684af2-ec83-4b2b-9afb-ec1296b357c9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.216314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.216983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.217266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.217541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.218404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:59.218710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.220130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.237578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 398/821] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:59.238712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.285447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1df3d-d3ae-444b-a3a8-acd2a7f951a5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.324162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.324916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.325108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.325372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.326126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.327536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.340478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb89061-ab0c-466b-9566-cbc8f7958894 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.373095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.373879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.374195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.374458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.375106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.376455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.388096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 12:59:59.389311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 399/822] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:59.390049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.426136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 424/823] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 12:59:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 12:59:59.426136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.529639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13079fe8-bdbd-4bf5-8a74-2371f4f034b2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.543868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74823073-b6c4-49a4-a6ac-e39091811f94 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.567236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.568139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.568421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.568696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/9d78c88153b34e0191d934a30bcb1f1f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.570899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=9d78c88153b34e0191d934a30bcb1f1f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.572422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.587542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.588556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.588933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.590004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.601742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.603733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.621216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 12:59:59.622909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 425/824] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 12:59:59.623661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.640516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 400/825] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 12:59:59 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/9d78c88153b34e0191d934a30bcb1f1f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 12:59:59.641575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.745974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e0c7-3f2b-4721-a84a-9b87428b29b9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.777034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bdbec-0a3a-4e38-b6f5-da7209c9a582 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.783539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.784485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.784915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.785352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.786274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] RBAC: Adding query filter params (name=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:59.786739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.788293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.795023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 426/826] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:59.801073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.846638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.847316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.847596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.847874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.848613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:59.848918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.850599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 12:59:59.879175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 401/827] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 12:59:59.884879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 12:59:59.954129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f271b73-ef67-47ef-a672-aed915af3082 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 12:59:59.990581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 12:59:59.991488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 12:59:59.991912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 12:59:59.992333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 12:59:59.993209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] RBAC: Adding query filter params (type=network) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 12:59:59.993655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 12:59:59.995192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.002603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 427/828] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:00.008336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:00.015265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee75a-b04b-49d0-b97d-58d8b3ba10d8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:00.059301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:00.060352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.061026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.061406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.070542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:00.072561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.090418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:00.096610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 402/829] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 12:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:00.097923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:00.135093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e8ebf-e701-48ff-94d0-ecd7ab78aa25 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:00.192896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2bc71-2c68-4a9c-b83a-09341de7e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:00.193927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2bc71-2c68-4a9c-b83a-09341de7e6a1 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.194450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2bc71-2c68-4a9c-b83a-09341de7e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.194923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2bc71-2c68-4a9c-b83a-09341de7e6a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.195886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2bc71-2c68-4a9c-b83a-09341de7e6a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:00.199839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2bc71-2c68-4a9c-b83a-09341de7e6a1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.256724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5b7dd-719a-4132-b77b-ed1553db1629 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:00.290362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:00.291019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.291297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.291568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.293126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:00.293430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:00.294950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.300651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 428/830] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:00.312651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71fc00-cc91-4864-8803-211b5c58d561 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.312959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71fc00-cc91-4864-8803-211b5c58d561 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.313244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71fc00-cc91-4864-8803-211b5c58d561 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.320997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 429/831] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:00.323412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.325285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.325963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.329086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 403/832] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:00.334969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:00.364528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:00.366664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:00.510253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 430/833] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:00.533338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:00.548127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce165-7eb7-4e2d-a5e6-eb9cb83458e9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:00.595530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:00.596926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.597643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.598355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/140c9cd9be1945ef98619be5d3cc84cb/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.620939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=140c9cd9be1945ef98619be5d3cc84cb, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:00.623113 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.650964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca168f7-6aae-4070-bf98-6e43f89774b7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:00.690964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 404/834] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:00:00 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/140c9cd9be1945ef98619be5d3cc84cb/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:00:00.703484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:00.704556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.704945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.705323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.706160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:00.707849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.723514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 13:00:00.725590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 431/835] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Apr 11 13:00:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:00.733624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:00.860617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373880d-38d0-49a5-810f-a585cfa3d5e8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:00.899519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:00.900195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:00.900478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:00.900748 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:00.901498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:00.902322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:00.903691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1867fe-734d-4cca-9df1-6be7a22ec5c2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:00.910590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 405/836] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:00.916200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:01.018203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28033-0efc-4d8f-a27e-672d7698d032 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:01.051205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:01.051868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:01.052145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:01.052418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:01.053127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:01.053429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:01.054805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07995-6d7f-4ec6-8e04-6f968ee27514 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:01.060270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 432/837] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:02.109819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d9293-fd65-4c88-9189-0a917963d5b3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.109819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d9293-fd65-4c88-9189-0a917963d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.109819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d9293-fd65-4c88-9189-0a917963d5b3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.111035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 406/838] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:02.116555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.117375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.117873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.135064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:02.137100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:02.163256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98593033-0ff9-4fc1-9d7f-b5b7085560c6 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.163578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98593033-0ff9-4fc1-9d7f-b5b7085560c6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.163820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98593033-0ff9-4fc1-9d7f-b5b7085560c6 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.165479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 407/839] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:02.171039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.171323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.171606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.189714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:02.190890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:02.211454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 433/840] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:02.234620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.261864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 408/841] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:02.287000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.348414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f345-a5fb-4dea-ae19-e636533ea92d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.390910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b7b8-687b-4fac-87d2-a5b97e674ff2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.393104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.394730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.395012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.395287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.395950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:02.397333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:02.416642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 13:00:02.425102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 434/842] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:02.426410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.435011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.435812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.436091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.436362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.446896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:02.454675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:00:02.460510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 409/843] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:02.461526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.552736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b276902-f86b-4789-a8e7-dfe56338f97e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.562031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5948b-54de-4621-9fe4-7256600398ff None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.596746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.597417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.597699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.597911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.598031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.598756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:02.599063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:02.599337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.599826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.600553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.600659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:02.601576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:02.602304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:02.604238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:02.610216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 410/844] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:02.611130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 435/845] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:02.619779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.619939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.722333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105674a-abc8-40c5-8f03-9ca6f99233f1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.724103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9cb8c-77dd-470d-8cc3-5147303b30ed None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.757981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.758829 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.759115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.759395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.760089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.760754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.761567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.761844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.762594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:02.762900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:02.764274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:02.771543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:02.773101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:02.774398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 411/846] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:02.793086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:02.794853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 436/847] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:02.800484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:02.909756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d6759-a57e-4f15-a103-c924ab6c06ab None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:02.950536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:02.951219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:02.951500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:02.951770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:02.952510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:02.952815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:02.954263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3399a-eab8-4e04-ae4e-ea568fce8db7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:02.968356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 412/848] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:02.974004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.083331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea461-3865-4ddb-824a-41361d571809 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.101231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf3651-dd64-4a7a-a103-5aa959959d47 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.101538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf3651-dd64-4a7a-a103-5aa959959d47 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.101788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf3651-dd64-4a7a-a103-5aa959959d47 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.104515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 413/849] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:03.109443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.109729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.110007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.119399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.120725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.121228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.122047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.127245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:03.128489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:03.130581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.132815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:03.148799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:00:03.150395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 437/850] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:00:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:03.156673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.213776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 414/851] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:03.239026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.268241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae099e-aeb0-4a3b-a5d1-b7011d48138e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.301851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.302620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.303323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.303605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.304734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:03.305044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.307222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:03.329798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 438/852] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:03.336523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.363282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcc63-4106-43fd-b882-5d88e2e3b948 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.411005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.412177 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.412517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.413016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.426533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:03.436387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:00:03.442206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 415/853] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:03.444183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.454545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf736ff-c25d-439a-bfb4-3d8b14bd2d47 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.489443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ee54-ed33-4dd1-a203-8d6ceafaf9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.490478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ee54-ed33-4dd1-a203-8d6ceafaf9cf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.490983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ee54-ed33-4dd1-a203-8d6ceafaf9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.491468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ee54-ed33-4dd1-a203-8d6ceafaf9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.543010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecdf7a-1c3f-4151-b047-04de64de6d9a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.560953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ee54-ed33-4dd1-a203-8d6ceafaf9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.562459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ee54-ed33-4dd1-a203-8d6ceafaf9cf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:03.576302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.577274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.577552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.577821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.578611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:03.578912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.580282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771861f-bbb9-419e-8cd2-c3f88dce0851 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:03.592757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 416/854] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:03.592757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301bbd1-7296-4660-982f-d68e92285c88 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.592757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301bbd1-7296-4660-982f-d68e92285c88 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.592757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301bbd1-7296-4660-982f-d68e92285c88 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.592757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 417/855] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:03.596599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301bbd1-7296-4660-982f-d68e92285c88 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.664499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 439/856] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:03.665921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.666243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.666522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.683849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:03.685026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:03.705721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301bbd1-7296-4660-982f-d68e92285c88 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.740001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.741070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.741560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.741832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.748647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 440/857] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:03.749483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.759268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.760770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:03.778746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:03.779964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 418/858] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:03.780709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.849456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092db3df-d45e-42c7-bbd4-fb2b8ca10054 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.881360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b503-884f-4797-876b-6b5c64e9d211 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:03.883237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.884100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.884389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.884666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.895590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.897142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:03.914013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:03.915261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 441/859] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:03.916021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:03.921497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:03.922196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:03.922477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:03.922760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:03.923497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:03.924881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.010222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 419/860] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:03 2022] POST /identity/v3/services => generated 269 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:04.010222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.028112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c37e2-1194-4fcb-bbec-5998c0ee95ec None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.082894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.083571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.083852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.084125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.084860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:04.085164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.086593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.106502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 442/861] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:04.107657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.138716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1562-1c02-497c-8850-74cd6b2994ce None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.174430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.175105 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.175478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.175757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.176494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:04.176799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.178248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.192861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 420/862] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:04.201207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.217145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f29dae-f360-4e11-8ce6-cf8a51299b4f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.256523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.257660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.258150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.258580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.267857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.269810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.290480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:00:04.292322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 443/863] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:04.297891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.308646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2607d2-e71b-4503-9911-706fba409c74 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.353393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.354484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.354876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.355220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.364458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.366520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.389232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:04.391250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 421/864] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:04.396785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.415272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a6fab-6135-4c6a-8acb-3085a49af3dc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.455995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.456680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.456964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.457242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.458542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:04.458861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.460588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.485188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 444/865] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:04.495095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.507973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f31500-c0b4-4615-8262-2a7939ac589d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.544064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.545062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.545528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.545998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.546927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:04.547341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.548866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.562484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 422/866] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:04.568159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.609914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121974d-c5a3-48f0-9f85-b974d25fd520 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.645532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.646536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.646991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.647430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.667659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac37db-7064-40ff-8847-43ba68ab60c9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.702709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.703365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.703647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.703921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:04.704754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=9d78c88153b34e0191d934a30bcb1f1f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:04.705065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.706521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.718514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 423/867] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/role_assignments?user.id=9d78c88153b34e0191d934a30bcb1f1f&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:04.719276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:04.720929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:04.836851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 445/868] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:04.843523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:04.958416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f93cf-5e1a-4931-8e81-7c7dc2018734 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:04.992670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:04.993471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:04.993750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:04.994021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.005289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:05.007077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:05.024406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:05.025937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 424/869] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:05.032178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:05.131125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e50ca-3eb3-4242-a2be-1eb097771c9c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:05.165487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:05.166446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.166895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.167894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.168761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:05.169218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:05.170749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2514f0-8135-4583-9d24-8576542905b9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:05.183505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 446/870] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:05.189282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:05.207579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a28c8-8fd0-4857-9131-8dd61a7a9f57 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.207913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a28c8-8fd0-4857-9131-8dd61a7a9f57 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.208138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a28c8-8fd0-4857-9131-8dd61a7a9f57 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.209773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 447/871] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:05.215902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.216289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.216497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.234674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:05.235817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:05.306155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 448/872] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:05 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:05.313325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc55e07-b61a-407f-b9e8-af029a168441 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:05.328250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:05.349417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:05.350819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.351308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.351786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.358957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:05.360651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:05.375192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:05.376943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 425/873] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:05.384801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:05.434956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85bbe5-43e9-424a-905f-23b557019f76 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:05.468583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:05.469250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.469529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.469800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.470570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:05.471925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:05.497484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd3db-08e2-491e-9b42-4b9a2c82d108 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:05.521973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 449/874] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:05 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:00:05.545603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:05.546724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.547205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.547670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.548730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:05.549271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:05.551014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb952f-8db8-415d-b31f-f1d841379482 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:05.570210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 426/875] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:05.572697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:05.687075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75004edb-250f-4c37-9fb2-4112bcae207f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:05.723643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:05.724350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:05.724637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:05.724910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:05.726020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=140c9cd9be1945ef98619be5d3cc84cb) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:05.726358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:05.727793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97f47a-bfba-472f-b2dd-d33f39e12cc5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:05.734641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 450/876] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:05 2022] GET /identity/v3/role_assignments?user.id=140c9cd9be1945ef98619be5d3cc84cb&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:06.413130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fff05-2db6-469b-ac9b-0eea725d48f7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:06.413621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fff05-2db6-469b-ac9b-0eea725d48f7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:06.413695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fff05-2db6-469b-ac9b-0eea725d48f7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:06.415327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 427/877] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:06.420823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:06.421234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:06.421399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:06.437877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:06.439103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:06.508091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 451/878] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:06.532640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fff05-2db6-469b-ac9b-0eea725d48f7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:06.636695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fff05-2db6-469b-ac9b-0eea725d48f7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:06.671171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:06.671987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:06.672266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:06.672536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:06.673192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:06.674586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:06.687132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 13:00:06.693210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 428/879] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Apr 11 13:00:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:06.695210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:06.802893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee2511-8a7a-499f-8465-009badc62635 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:06.837812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:06.839714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:06.840182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:06.840634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:06.841518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:06.842001 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:06.843573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:06.853560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 452/880] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:06.855319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:06.959249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673796dc-5ff0-4fc7-9a8e-48a198cdc2a4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:06.994255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:06.995437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:06.996079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:06.996533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:06.997420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:06.997918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:06.999550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e400a6-0afd-4e9c-95a8-7960a35f149f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:07.009301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 429/881] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:07.011524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:07.112684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15502-8e23-4016-9b24-8400ec4628c1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:07.132818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59911f4-427a-4b4f-a320-e2dcca0df924 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.133096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59911f4-427a-4b4f-a320-e2dcca0df924 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.133376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59911f4-427a-4b4f-a320-e2dcca0df924 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.135044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 430/882] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:07.140411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.140703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.140984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.150915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:07.152530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.152992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.153712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.154733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] RBAC: Adding query filter params (interface=public, service_id=e20b3d3f55804801af55aef71818c5d8, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:07.155221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:07.156752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:07.157299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:07.158569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:07.169141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 453/883] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 13:00:07 2022] GET /identity/v3/endpoints?service_id=e20b3d3f55804801af55aef71818c5d8&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:07.171415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:07.228955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 431/884] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:07.251415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:07.284427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550a814-9804-470e-a408-e8125bdb9f8f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:07.319227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:07.320206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.320734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.321223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.322206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:07.323833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:07.338293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 454/885] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:00:07 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:00:07.368265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3090a0-aaee-4ab2-b017-4a0f4d614af2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:07.406435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:07.407261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.407544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.407819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.408489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:07.409885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:07.422705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:00:07.424316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 432/886] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:07.431733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:07.538602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1e692-a1fa-4cf1-9ea6-ba72930a8ab5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:07.573509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:07.574214 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.574499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.574780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.575490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:07.575795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:07.577159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fef0b-e6b7-43e1-b598-59a1a7a95bd6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:07.586493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 455/887] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:07.588154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:07.694502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1e22-9259-4c97-8ad1-163b5d36fdf2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:07.728635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:07.729324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.729666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.729915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.730695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:07.731005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:07.732434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff113b-1512-488a-bf5f-9e0762a6db25 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:07.738128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 433/888] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:07.989022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7529b-31f8-4be4-aa90-44785791e20e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.989310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7529b-31f8-4be4-aa90-44785791e20e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.989498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7529b-31f8-4be4-aa90-44785791e20e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:07.991190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 456/889] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:07.997030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf7a5-6228-4463-b81a-4eb61eaf339a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:07.997322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf7a5-6228-4463-b81a-4eb61eaf339a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:07.997602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf7a5-6228-4463-b81a-4eb61eaf339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.014480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-758cf7a5-6228-4463-b81a-4eb61eaf339a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:08.015662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-758cf7a5-6228-4463-b81a-4eb61eaf339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:08.083610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 434/890] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:08.108167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7529b-31f8-4be4-aa90-44785791e20e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.122085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada6b80-c89e-4d4c-986b-668838a064ba None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.122406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada6b80-c89e-4d4c-986b-668838a064ba None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.122669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada6b80-c89e-4d4c-986b-668838a064ba None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.124322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 435/891] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:08.129488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.129774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.130056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.151091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:08.153092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:08.224254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7529b-31f8-4be4-aa90-44785791e20e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.231059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 436/892] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:08.254880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.265219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.266442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.266728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.267007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.267958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.269659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.285254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 13:00:08.286800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 457/893] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:08.293198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.360744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0843c-c341-4df3-891e-c19d43ceb694 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.400219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.400788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.401067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.401341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.406874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa5dbb-9ea4-45bc-87a6-e37d1eeea8f7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.412003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:08.419761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:00:08.425855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 437/894] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:08.426767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.443766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.445112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.445594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.446070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.447005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:08.447509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.449927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.459786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 458/895] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:08.460906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.527898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08138b-c1bc-41d6-8898-66912eaf0e95 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.561775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.562477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.562757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.563030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.563776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:08.564079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.565439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.566079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070373-1521-4eb6-b37b-e187e476ebd9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.578375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 438/896] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:08.579512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.601400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.602467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.602953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.603429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.604361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:08.605442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.607043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.617175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 459/897] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:08.618417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.680289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458a83-d9ac-443c-ab5e-70652b46a9ea None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.713594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.715030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.715493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.715667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.719549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d095d63-afcd-4c05-8c89-7c1faba8c9fd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.726384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.727812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.743969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:08.750128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 439/898] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:08.750999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.754361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.755305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.755785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.756255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.757246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] RBAC: Adding query filter params (interface=public, service_id=90d6e2ff62034b60a1034543fe867283, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:08.757754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.759362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.770124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 460/899] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/endpoints?service_id=90d6e2ff62034b60a1034543fe867283&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:08.771290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.849740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f4ee-d3c5-4f35-b370-4322270dc76e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.874362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db504f27-ce1c-4085-a668-0bb8c7d53c7e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:08.883338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.884003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.884305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.884800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.885267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:08.885566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.887476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.904867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 440/900] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:08.905838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:08.911737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:08.912763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:08.913246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:08.913721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:08.914675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:08.916331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:08.930345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 461/901] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:00:09.016900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8a91-9bba-41af-ac08-cee82c3d6c3c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:09.053648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:09.054508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.054785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.055053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.063656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:09.065133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:09.080555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:00:09.086232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 441/902] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:00:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:09.091392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:09.193958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7719c-8b22-42c1-89d6-cb3a2da7c6f7 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:09.228392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:09.229416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.230745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.231272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.232327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:09.232830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:09.234478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:09.252929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 462/903] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Apr 11 13:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:09.258226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:09.362080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7afd9-b827-4a68-baa7-a28430cda07d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:09.405498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85677e3-82a3-4c40-9005-2676c66ce27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:09.407318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85677e3-82a3-4c40-9005-2676c66ce27d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.407318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85677e3-82a3-4c40-9005-2676c66ce27d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.407318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85677e3-82a3-4c40-9005-2676c66ce27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.474137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85677e3-82a3-4c40-9005-2676c66ce27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:09.476489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85677e3-82a3-4c40-9005-2676c66ce27d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:09.575837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 442/904] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:09.581708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:09.681055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad9a64-393f-456c-ac3f-033840b3e40d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:09.715211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:09.716239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.716765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.717177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.727773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:09.729385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:09.746871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff21e-885d-4a3d-a507-21bcfca6adb3 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.747491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff21e-885d-4a3d-a507-21bcfca6adb3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.747594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:09.748050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff21e-885d-4a3d-a507-21bcfca6adb3 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.749148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 463/905] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:09.750100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 443/906] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:09.754965 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:09.759666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.760069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.760441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.778844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:09.780233 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:09.862203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 444/907] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:09.872871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17705a-5156-4b54-aa61-1d1b408f619f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:09.884093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:09.916128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:09.917552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:09.918188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:09.919016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:09.920179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:09.920680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:09.923164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:09.937754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 464/908] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:09.943307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:09.997675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de934-762a-4c69-b69f-d29d53d2b15e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.037391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.038571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.039079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.039529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.040449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.042134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.054800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 13:00:10.061873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3083a-8b48-4f0e-8159-fc2701e7d418 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.062210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 445/909] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Apr 11 13:00:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:10.063283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:10.092449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.093280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.093560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.093836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.101437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.102729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.117410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:10.118952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 465/910] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:10.125260 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:10.173041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54583edd-2005-4e51-b570-24d229a64864 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.206717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.207377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.207656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.207925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.208628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:10.208928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.210313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a8dec-6039-49b1-8c85-e54ed054c81b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.214908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 446/911] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:10.216115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c66f-90b7-4ae0-ae52-9cc12918e6e9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.216397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c66f-90b7-4ae0-ae52-9cc12918e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.216674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351c66f-90b7-4ae0-ae52-9cc12918e6e9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.221959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 447/912] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:10.221959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351c66f-90b7-4ae0-ae52-9cc12918e6e9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:10.238508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd954e1-6eba-4bea-94c2-2c31fb7d8119 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.273770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.274474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.274761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.275041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.275870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:10.276180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.277855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865a84-407a-4c7d-977f-833a250a8e3b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.297399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 466/913] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:10.299645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.300052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.300432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.318623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:10.319814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:10.334041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351c66f-90b7-4ae0-ae52-9cc12918e6e9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.368198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.368858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.369142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.369417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.370237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:10.371392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.372575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.382152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 448/914] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:10.382152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:10.396206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 467/915] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:10.397598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:10.475217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dd72a-1b4c-4241-87c7-1957c0f2a3dc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.507775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df900a-29a6-41fb-a118-2a3937b6c57f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.510035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.510740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.511205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.511497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.512323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] RBAC: Adding query filter params (role.id=983bce756b8a46ae9ba7241136be1f65, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=140c9cd9be1945ef98619be5d3cc84cb) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:10.512637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.514057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.520848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 449/916] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:10 2022] GET /identity/v3/role_assignments?user.id=140c9cd9be1945ef98619be5d3cc84cb&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=983bce756b8a46ae9ba7241136be1f65 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:10.521276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:10.555603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ff34c-5c96-4607-8742-2cbc1585bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.557390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff34c-5c96-4607-8742-2cbc1585bcbf None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.557612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff34c-5c96-4607-8742-2cbc1585bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.557945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff34c-5c96-4607-8742-2cbc1585bcbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.559121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ff34c-5c96-4607-8742-2cbc1585bcbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.560538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ff34c-5c96-4607-8742-2cbc1585bcbf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.634459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515987d8-af22-4bed-ab0c-83e3234cfeb1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:10.640268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 468/917] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:10.687197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb46f9-60b8-4db5-96ca-f33f5a953484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:10.687908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb46f9-60b8-4db5-96ca-f33f5a953484 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:10.688194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb46f9-60b8-4db5-96ca-f33f5a953484 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:10.688477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb46f9-60b8-4db5-96ca-f33f5a953484 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:10.689394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb46f9-60b8-4db5-96ca-f33f5a953484 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:10.690878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb46f9-60b8-4db5-96ca-f33f5a953484 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:10.759981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 450/918] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:10 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:11.356018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a542-f36f-480d-a516-57cdbd86d24c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:11.356396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a542-f36f-480d-a516-57cdbd86d24c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:11.356590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a542-f36f-480d-a516-57cdbd86d24c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:11.358222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 469/919] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:11.363550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:11.363838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:11.364120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:11.381163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:11.382388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:11.456284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 451/920] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:11.480508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a542-f36f-480d-a516-57cdbd86d24c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:11.586392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a542-f36f-480d-a516-57cdbd86d24c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:11.623206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:11.623937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:11.624223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:11.624500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:11.625164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:11.626629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:11.638531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 13:00:11.640078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 470/921] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:11.645671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:11.751134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20da98-1e76-4af4-a4c1-d0aeb819b72d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:11.785037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:11.786076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:11.786581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:11.787077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:11.787979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:11.788481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:11.790034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:11.796307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 452/922] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:11.806236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:11.912362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155465d-a3fa-42da-be1f-0c9ed4541aad None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:11.945863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:11.946573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:11.946858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:11.947136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:11.947854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:11.948164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:11.950345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82599dc-f319-4241-a5b7-41c6a63946b2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:11.955658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 471/923] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Apr 11 13:00:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:11.961029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:12.065501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840b1b-9092-4116-a2aa-daeb0299e5f2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:12.099284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f353-c5c0-4f0b-9a71-8c644ce85dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:12.099942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f353-c5c0-4f0b-9a71-8c644ce85dd7 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:12.100220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f353-c5c0-4f0b-9a71-8c644ce85dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:12.100762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f353-c5c0-4f0b-9a71-8c644ce85dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:12.101514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f353-c5c0-4f0b-9a71-8c644ce85dd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:12.102899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2f353-c5c0-4f0b-9a71-8c644ce85dd7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:12.189552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 453/924] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:12.948440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2191-4b60-48a3-b8e5-65bafa36536c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:12.949430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2191-4b60-48a3-b8e5-65bafa36536c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:12.949917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2191-4b60-48a3-b8e5-65bafa36536c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:12.951800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 472/925] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:12.959711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef9e5-9642-4e43-bbdf-81f13a15ecb4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:12.960605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef9e5-9642-4e43-bbdf-81f13a15ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:12.961084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef9e5-9642-4e43-bbdf-81f13a15ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:12.980743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-576ef9e5-9642-4e43-bbdf-81f13a15ecb4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:12.982426 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-576ef9e5-9642-4e43-bbdf-81f13a15ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:13.056216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 454/926] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:13.078917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2191-4b60-48a3-b8e5-65bafa36536c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.087769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad45e45-02f6-4ba9-bb4c-5ac159a07e88 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.088058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad45e45-02f6-4ba9-bb4c-5ac159a07e88 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.088337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad45e45-02f6-4ba9-bb4c-5ac159a07e88 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.091439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 455/927] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:13.098244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464dc2f-b51f-4ac9-901c-164f7f14e392 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.098597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464dc2f-b51f-4ac9-901c-164f7f14e392 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.098958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464dc2f-b51f-4ac9-901c-164f7f14e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.120308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3464dc2f-b51f-4ac9-901c-164f7f14e392 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:13.121744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3464dc2f-b51f-4ac9-901c-164f7f14e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:13.204757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 456/928] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:13.206171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2191-4b60-48a3-b8e5-65bafa36536c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.211637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b3d05-88fb-4071-93f3-e227495b2a3f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.212034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b3d05-88fb-4071-93f3-e227495b2a3f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.212414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b3d05-88fb-4071-93f3-e227495b2a3f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.214257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 457/929] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:13.219698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.220142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.220636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.238585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:13.239758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:13.243758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.244574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.244855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.246023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.256766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:13.265010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:00:13.270350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 473/930] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:13.270350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.314158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 458/931] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:13.314158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.399398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a68be5-650f-42e9-877a-17c545b10893 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.415338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de899e58-a0e2-4e48-b4f9-4a8661b80eec None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.432586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.433897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.434198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.434471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.435125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.436486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.447298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 13:00:13.454588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 474/932] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:13.454588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.455753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.456387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.456674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.456953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.457964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:13.458306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.459713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.468078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 459/933] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:13.471024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.554587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41920-9411-4204-94ba-ee992867f21b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.568469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b2de-6884-4f59-b36b-35c3a7ec76c5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.592030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.592831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.593109 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.593545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.594019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.595391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.601169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.601825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.602127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.602400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.603108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:13.603407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.605337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.607285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:00:13.613360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 475/934] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:13.613360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.613548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 460/935] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:13.617093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.711194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ba0a7-1dd1-4d22-9928-9194d6b097d6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.712513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b989-9471-4102-bf35-75abc6bb0f13 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.745715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.746225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.746539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.746820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.746914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.747091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.747195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.747399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.748100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:13.748406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.749763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.758980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 461/936] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:13.758980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.762653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.764166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.780931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:13.782205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 476/937] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:13.786807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.863140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862b0a5-c5d0-473f-929c-961bf2a341a0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.884930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd90cf-9ce3-4980-bf52-b37175a2d786 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:13.905385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.906523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.906834 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.907131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.907980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:13.908151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.909536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.922284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 462/938] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:13.922284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:13.927226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:13.928005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:13.928357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:13.928704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:13.929546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:13.929917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:13.931419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:13.941706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 477/939] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:13.942946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.037320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20788f7c-64a6-47ff-862b-953bcd342d41 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.052222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f584b-0027-46bd-a6bd-44289f8e28aa None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.074727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.075529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.075810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.076081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.076836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:14.077118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.078665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.096745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 463/940] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:14.096932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.096932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.096932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.096932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.097867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.098985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] RBAC: Adding query filter params (interface=public, service_id=eab4ba86f6db4944aa83b5d698d0a406, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:14.099838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.101788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.113287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 478/941] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 13:00:13 2022] GET /identity/v3/endpoints?service_id=eab4ba86f6db4944aa83b5d698d0a406&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:14.114558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.218467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42349dfe-26f7-4d69-b48d-a72802006a9f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.225910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7f60-10b2-4e46-8151-be8b07569e66 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.253199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.254380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.254840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.255329 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.263579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.265375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.266809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.267792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.268169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.269064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.269858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.271324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.286136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 479/942] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:00:14.286338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:00:14.287705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 464/943] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:14.293350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.413722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc013-8595-4f38-a3ba-b34b6f590811 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.456874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.457558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.457838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.458130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.458995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:14.459299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.460721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc5cf-a807-43f0-a09d-5e8270c88824 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.481022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 480/944] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:14.486501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.588696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b9a8-982d-4df7-af1e-136893696bf2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.590591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc14220-23e2-45f9-baf6-8232edef9200 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.590999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc14220-23e2-45f9-baf6-8232edef9200 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.591379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc14220-23e2-45f9-baf6-8232edef9200 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.594083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 481/945] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:14.598451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.598839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.599215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.621387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:14.623557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:14.630316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.631115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.631391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.631659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.644372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.646280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.668135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:14.674178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 465/946] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:14.676228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.714149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 482/947] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:14.733011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.794267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294083b6-95cf-40bf-83be-3c28160c8bf5 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.828720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.829385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.829664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.829935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.830699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:14.831002 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.832364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.841915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82edf0-a740-4cd4-ab14-d13d40994b83 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.846029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 466/948] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:14.855525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.878989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.879927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.880410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.880849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:14.881734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:14.883354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:14.884868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.common [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 13:00:14.955915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29837-054d-4355-92ac-9d3d797d9691 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:14.976118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.sql.core [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 11 13:00:14.976118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 11 13:00:14.976118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [parameters: {'id': 'afb8c30c7e44493183d1550f07c20b5f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 11 13:00:14.976118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80226) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 13:00:14.983642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id afb8c30c7e44493183d1550f07c20b5f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id afb8c30c7e44493183d1550f07c20b5f. Apr 11 13:00:14.989923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 483/949] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Apr 11 13:00:14 2022] POST /identity/v3/projects => generated 262 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:14.991204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:14.991561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:14.992468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:14.992951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:14.993440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:15.002579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:15.004737 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:15.024998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:15.032118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 467/950] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:15.032805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:15.103619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd87d7-9772-41e9-8ce5-d442ef9fa2a4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:15.139959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:15.140995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:15.141416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:15.141865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:15.151543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:15.153817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:15.162399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab38174-b627-4994-aa25-928543f3a3bf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:15.171359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:15.177691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 484/951] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:15.179831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:15.203889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:15.204786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:15.205206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:15.205644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:15.206606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:15.207091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:15.208789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:15.221699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 468/952] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:15.228432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:15.308785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230efb5-897d-4d81-b1c9-9058cb356a3c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:15.330047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748750-2a97-4013-8c2b-6bc56640ab22 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:15.352148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:15.353224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:15.353601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:15.354045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:15.355643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:15.356375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:15.358174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496cf5d-0124-4854-929d-2c582c6cd54b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:15.366720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4aaa51-9d51-400e-87bb-749ec7af19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:15.367771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4aaa51-9d51-400e-87bb-749ec7af19e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:15.368190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4aaa51-9d51-400e-87bb-749ec7af19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:15.368658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4aaa51-9d51-400e-87bb-749ec7af19e5 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/140c9cd9be1945ef98619be5d3cc84cb/roles/983bce756b8a46ae9ba7241136be1f65` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:15.372173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4aaa51-9d51-400e-87bb-749ec7af19e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=140c9cd9be1945ef98619be5d3cc84cb, role_id=983bce756b8a46ae9ba7241136be1f65)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:15.374255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4aaa51-9d51-400e-87bb-749ec7af19e5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:15.384473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 485/953] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:15.452619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 469/954] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:00:15 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/140c9cd9be1945ef98619be5d3cc84cb/roles/983bce756b8a46ae9ba7241136be1f65 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:00:16.305808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0474-343d-4a7f-b550-2648fa81ed6b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:16.306394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0474-343d-4a7f-b550-2648fa81ed6b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:16.306394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0474-343d-4a7f-b550-2648fa81ed6b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:16.308603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 486/955] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:16.314673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352241-ecfc-43b5-8e9e-5cdedcc4bc4b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:16.315179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352241-ecfc-43b5-8e9e-5cdedcc4bc4b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:16.315283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352241-ecfc-43b5-8e9e-5cdedcc4bc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:16.332306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-43352241-ecfc-43b5-8e9e-5cdedcc4bc4b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:16.333472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-43352241-ecfc-43b5-8e9e-5cdedcc4bc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:16.402410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 470/956] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:16.426997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0474-343d-4a7f-b550-2648fa81ed6b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:16.527464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0474-343d-4a7f-b550-2648fa81ed6b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:16.562906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:16.563496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:16.563778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:16.564052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:16.564786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:16.566153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:16.680608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fdd66-08e6-4c63-ac36-6b73acc249fb None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:16.680930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fdd66-08e6-4c63-ac36-6b73acc249fb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:16.681178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fdd66-08e6-4c63-ac36-6b73acc249fb None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:16.682892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 471/957] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:16.686955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 487/958] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:16 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:16.687913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:16.688206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:16.688487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:16.707714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:16.709165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:16.796116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 472/959] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:16.821051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:16.924602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e80bda-39bf-4679-a073-0be244d0f9d9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:16.959204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:16.960016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:16.960302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:16.960580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:16.961237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:16.962630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:16.975109 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:00:16.976892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 488/960] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:16.982812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:17.084572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8a9c-ee9e-4809-abea-b918f7f2fad9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:17.119017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:17.119686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.119973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.120373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.121092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:17.121398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:17.122808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:17.128024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 473/961] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:17.133708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:17.234365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2062-37af-4c2c-82a8-6dcf5b8508a4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:17.268342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:17.269013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.269301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.269576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.270314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:17.270620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:17.271978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229106c-d9d5-46da-bdf4-e8698f67e4fd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:17.278213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 489/962] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:17.283557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:17.383469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308370f-64a7-4c9f-b912-45b7f13d57b7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:17.417252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42210c-fc72-4f53-b4fb-1cc899070187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:17.417914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42210c-fc72-4f53-b4fb-1cc899070187 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.418235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42210c-fc72-4f53-b4fb-1cc899070187 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.418512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42210c-fc72-4f53-b4fb-1cc899070187 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.419263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42210c-fc72-4f53-b4fb-1cc899070187 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:17.420642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42210c-fc72-4f53-b4fb-1cc899070187 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:17.503996 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 474/963] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:17.888979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7f1c-e140-4f24-8e64-986aee2a1c78 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.890035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7f1c-e140-4f24-8e64-986aee2a1c78 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.890587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7f1c-e140-4f24-8e64-986aee2a1c78 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.892605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 490/964] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:17.898813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3091946-ab15-4a06-b816-53111c021851 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.899443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3091946-ab15-4a06-b816-53111c021851 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.899911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3091946-ab15-4a06-b816-53111c021851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.903859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4151fa-b738-403c-bbf4-7898e6a60851 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.904146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4151fa-b738-403c-bbf4-7898e6a60851 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.904430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4151fa-b738-403c-bbf4-7898e6a60851 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.906151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 491/965] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:17.911525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a202a-150e-4d56-af18-728723d542ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:17.911815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a202a-150e-4d56-af18-728723d542ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:17.912098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a202a-150e-4d56-af18-728723d542ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:17.921391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a3091946-ab15-4a06-b816-53111c021851 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:17.922894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a3091946-ab15-4a06-b816-53111c021851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:17.929264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e34a202a-150e-4d56-af18-728723d542ca None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:17.930801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e34a202a-150e-4d56-af18-728723d542ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:18.005754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 492/966] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:18.018196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 475/967] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:18.030155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a202a-150e-4d56-af18-728723d542ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.039107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3091946-ab15-4a06-b816-53111c021851 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.128115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a202a-150e-4d56-af18-728723d542ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.162611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3091946-ab15-4a06-b816-53111c021851 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.170506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.171923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.172421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.173210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.187342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:18.196052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.196729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.197010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.197299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.197993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.199206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:00:18.199649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.201026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.common [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 13:00:18.201515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 493/968] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:18.207421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.239307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.sql.core [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 11 13:00:18.239307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 11 13:00:18.239307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [parameters: {'user_id': '6c78ad79b5604575b638e2ee790464dd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 11 13:00:18.239307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80227) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 13:00:18.259882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 11 13:00:18.262170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 476/969] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Apr 11 13:00:18 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:18.267890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.325330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b97ee-af77-4a18-892c-4a33cc0318db None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.368007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.368690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.368977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.369256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.370553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:18.370903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.372750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.383662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 494/970] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:18.388322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.400216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df535ca-8170-4327-bd66-371563d2494c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.437148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.437855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.438336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.438767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.446941 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.449348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.463208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 13:00:18.465042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 477/971] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:18.470836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.516185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fb4f4-54eb-452b-bf75-297c2fd57dd9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.550700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.551878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.552352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.552827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.563902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.565582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.574513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826bff1-00e9-48df-835d-6f0879e0c88f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.583533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:18.590101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 495/972] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:18.592150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.610571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.611292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.611577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.611854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.612728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:18.613035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.614543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.658647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 478/973] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:18.708814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0771-8735-4853-b901-cbc772a768bf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.747657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.748348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.748630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.748905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.749653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:18.749960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.751426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.765865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 496/974] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:18.772260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:18.887761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc42b-110e-4939-8854-7e4e6e0890dd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:18.923312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:18.924568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:18.925048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:18.925600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:18.933535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:18.935234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:18.950711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:00:18.954095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 479/975] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:18.958411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.057403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b6d7a-06a9-42bd-bfbc-48c0f587ddad None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.090379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.091072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.091336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.091610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.092453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:19.092761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.094230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7a53-a343-499b-84da-6aced2e14a2b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.112026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 497/976] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Apr 11 13:00:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:19.117740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.127890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d22e6c-5bf1-4593-91c5-c3895a0a08c9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.128175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d22e6c-5bf1-4593-91c5-c3895a0a08c9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.128650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d22e6c-5bf1-4593-91c5-c3895a0a08c9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.130022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 498/977] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:19.134979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.135293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.135574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.155141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:19.156313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:19.219998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599f53c-4d04-4355-822f-20fb55d2fdea None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.226138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 499/978] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:19.246566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.259948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.260681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.260966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.261234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.326455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.327822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.345910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e90c8b-b384-4fd0-8682-b981729b7004 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.390776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.391584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.391865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.392135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.392794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.396674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.408794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 13:00:19.411400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 500/979] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:19.417466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.436192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 480/980] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:19.437369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.517917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fb1ef-ece2-4c5c-b945-c4269a23771e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.538346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0006d-54e5-4a3a-b164-b49801cddc86 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.552609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.553284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.553878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.554192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.554909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:19.555214 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.556619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.566682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 501/981] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:19.567741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.571920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.572713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.572991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.573806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.584109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.585496 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.602259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:19.603459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 481/982] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:19.609536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.673579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd9e2-13ff-4f1a-8dd1-4307a13cdd8b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.709141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5570-12e8-422d-a00f-0aee9b73a9e0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.709325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.709901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.710208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.710483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.711192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:19.711493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.712859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.718369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 502/983] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:19.723996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.746774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.747575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.747861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.748134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.748857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:19.749162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.750571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.767182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 482/984] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:19.768531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.821580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f5a0-c700-4d50-af85-a65a8ab8dc0f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.858063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.858676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.858954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.859218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.860009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] RBAC: Adding query filter params (interface=public, service_id=5d36f617eac443aa8ab89cb98e566c56, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:19.860315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.861672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.866833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 503/985] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/endpoints?service_id=5d36f617eac443aa8ab89cb98e566c56&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:19.872125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.873506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ceeb2-eeea-4580-9dff-411aff028f29 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.907725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.908523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.908805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.909082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.915579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:19.917675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:19.931014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7b4a6ac5-db87-46b3-b084-7d713f54ce06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:19.932206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 483/986] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:19.933527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb337c6-4727-46ee-b847-2cffb32fa719 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.933812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb337c6-4727-46ee-b847-2cffb32fa719 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.934090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb337c6-4727-46ee-b847-2cffb32fa719 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:19.938332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 484/987] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:19.939029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb337c6-4727-46ee-b847-2cffb32fa719 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:19.967203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f70c90-6173-4ee8-b517-db4cd7f4e59d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:19.998683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cf5d6-b013-49cb-abdd-819c464071da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:19.999367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf5d6-b013-49cb-abdd-819c464071da None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:19.999646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf5d6-b013-49cb-abdd-819c464071da None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:19.999921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf5d6-b013-49cb-abdd-819c464071da None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.000597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cf5d6-b013-49cb-abdd-819c464071da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.001955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cf5d6-b013-49cb-abdd-819c464071da None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.008063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 504/988] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:00:20.009221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.009506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.009785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.028880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:20.030133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:20.050501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb337c6-4727-46ee-b847-2cffb32fa719 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.088072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.088915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.089734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.089995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.090847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:20.091211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.092684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.100111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 505/989] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:20.106878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 485/990] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:20.112912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:20.124632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:20.218246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2065ec-858d-449d-834b-74a940ef4559 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.230778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97f75-907e-4fbc-a282-8ecbb880dee4 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.253190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.253856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.254165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.254446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.255282 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] RBAC: Adding query filter params (role.id=983bce756b8a46ae9ba7241136be1f65, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=140c9cd9be1945ef98619be5d3cc84cb) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:20.255600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.257020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.263440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 506/991] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:20 2022] GET /identity/v3/role_assignments?user.id=140c9cd9be1945ef98619be5d3cc84cb&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=983bce756b8a46ae9ba7241136be1f65 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:20.269279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.270201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.270422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.270699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.271434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.272950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.286235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:00:20.290195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 486/992] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:20.293708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:20.403469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275743f-9c33-4dad-b19c-aa206e236e30 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.441186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.441866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.442173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.442454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.443173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:20.443479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.444847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.454169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 507/993] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:20.456537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:20.557912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45a168-7554-490d-9fa7-8af93efc44d7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.589416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.590022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.590324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.590603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.591300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:20.591604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.592968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.597887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 487/994] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:20.603757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:20.700672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1da4-e3c3-4fd4-8bf2-7c652bf5af88 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.733521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.734214 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.734503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.734778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.735612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] RBAC: Adding query filter params (interface=admin, service_id=eab4ba86f6db4944aa83b5d698d0a406, region_id=RegionOne) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:20.735926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.737273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a751c1-04bc-4fda-86f3-25b4def6ab84 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.742317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 508/995] 10.222.0.49 () {56 vars in 1249 bytes} [Mon Apr 11 13:00:20 2022] GET /identity/v3/endpoints?service_id=eab4ba86f6db4944aa83b5d698d0a406&interface=admin®ion_id=RegionOne => generated 193 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:20.747646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:20.847063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776925a8-2ba2-4a90-995d-b8f0c27ddb8d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:20.881349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb057c-7b9d-42cc-ac94-3ead54f0789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:20.882021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb057c-7b9d-42cc-ac94-3ead54f0789d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:20.882330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb057c-7b9d-42cc-ac94-3ead54f0789d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:20.882607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb057c-7b9d-42cc-ac94-3ead54f0789d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:20.883292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb057c-7b9d-42cc-ac94-3ead54f0789d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:20.884692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb057c-7b9d-42cc-ac94-3ead54f0789d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:20.891626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 488/996] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:00:20 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:00:22.345899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944698e-2aba-46ca-a512-3bcfe3badd73 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.346455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944698e-2aba-46ca-a512-3bcfe3badd73 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.346531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944698e-2aba-46ca-a512-3bcfe3badd73 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.347917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 509/997] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:22.353276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc7f1d-c884-45a4-8d05-215ad9a307f3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.353678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc7f1d-c884-45a4-8d05-215ad9a307f3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.353875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc7f1d-c884-45a4-8d05-215ad9a307f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.371777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e4cc7f1d-c884-45a4-8d05-215ad9a307f3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:22.373297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e4cc7f1d-c884-45a4-8d05-215ad9a307f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:22.444152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 489/998] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:22.470332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944698e-2aba-46ca-a512-3bcfe3badd73 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:22.569755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944698e-2aba-46ca-a512-3bcfe3badd73 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:22.602762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:22.603488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.603770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.604045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.605340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:22.606689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:22.613099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb255b9-b6f9-4e67-8078-3f16494ed322 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.613386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb255b9-b6f9-4e67-8078-3f16494ed322 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.613663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb255b9-b6f9-4e67-8078-3f16494ed322 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.615207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 490/999] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:22.617752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 13:00:22.619832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.620142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 510/1000] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:22.620254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.620540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.625003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:22.639109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:22.640274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:22.706011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 491/1001] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:22.723176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf3cf-3ff9-4a30-a049-131c16a1b083 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:22.728766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:22.757548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:22.758247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.758535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.758813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.759535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:22.759843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:22.761859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:22.766721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 511/1002] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:22.772920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:22.831689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d669a9d-8406-4b54-9634-fb093d591bb3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:22.869558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:22.870925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.871224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.871501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] PATH_INFO: `/v3/services/image` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.872167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:22.873543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:22.880385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9b9a-e31c-4e0a-917a-b87b8f393762 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:22.884304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 13:00:22.885735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 492/1003] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Apr 11 13:00:22 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:22.893256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:22.914789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:22.915467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:22.915758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:22.916037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:22.918676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:22.918996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:22.920871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:22.926281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 512/1004] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Apr 11 13:00:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:22.932138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:22.994290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ac7a-a239-4bdd-b5ac-06d460693608 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.028118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.028782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.029061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.029337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.030037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] RBAC: Adding query filter params (name=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:23.030370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.031726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:23.036952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 493/1005] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:23.042324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:23.047623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac4d3-ab85-480b-9732-a63214ef380b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.080367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6acdd-5c2d-4690-af23-5fafea7acbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.081027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6acdd-5c2d-4690-af23-5fafea7acbbd None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.081304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6acdd-5c2d-4690-af23-5fafea7acbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.081733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6acdd-5c2d-4690-af23-5fafea7acbbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.082502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6acdd-5c2d-4690-af23-5fafea7acbbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.083848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6acdd-5c2d-4690-af23-5fafea7acbbd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:23.142287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edba700-c670-4db8-ad1d-c067df696554 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.174725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.175383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.175659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.175928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.176627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] RBAC: Adding query filter params (type=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:23.176927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.178315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9183ed-9737-4299-81bf-ef4d1564b28d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:23.183217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 494/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:23.194411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 513/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:23.217680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec34c7-6722-40a9-a8eb-e720eea30f94 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.217992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec34c7-6722-40a9-a8eb-e720eea30f94 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.218292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec34c7-6722-40a9-a8eb-e720eea30f94 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.219993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 495/1008] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:23.226575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.226994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.227350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.246929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:23.248365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:23.338067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 514/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:23 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:23.365296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec34c7-6722-40a9-a8eb-e720eea30f94 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:23.484464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec34c7-6722-40a9-a8eb-e720eea30f94 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.521399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.522284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.522570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.522846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.523509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.525065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:23.537799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:00:23.539079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 496/1010] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Apr 11 13:00:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:23.545753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:23.642807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612612a5-2946-4d08-91eb-3536a2ce8df6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.676329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.677004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.677285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.677558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.678294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:23.678602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.679953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:23.689272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 515/1011] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:23.690865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:23.796109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223966-9485-4fce-a19f-b1d7b8307ffd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.829517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.830285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.830575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.830853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.831652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:23.831963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.833328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137d2f4-3145-4910-8095-95934d820c51 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:23.838439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 497/1012] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Apr 11 13:00:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:23.845121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:23.945126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4b669-8189-4f3c-bfea-cc4d0e0726b3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:23.979506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc32a1-5f02-41c4-8152-57136fc18c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:23.980054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc32a1-5f02-41c4-8152-57136fc18c5d None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:23.980345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc32a1-5f02-41c4-8152-57136fc18c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:23.980684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc32a1-5f02-41c4-8152-57136fc18c5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:23.981448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc32a1-5f02-41c4-8152-57136fc18c5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:23.982856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc32a1-5f02-41c4-8152-57136fc18c5d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:24.044447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 516/1013] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:25.529479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee247c20-630a-4239-abbd-35350f0f1bd1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:25.529987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee247c20-630a-4239-abbd-35350f0f1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:25.530062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee247c20-630a-4239-abbd-35350f0f1bd1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:25.531601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 498/1014] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:25.536477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051930c8-bcb5-413d-9f93-313bb9612f53 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:25.536864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051930c8-bcb5-413d-9f93-313bb9612f53 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:25.537050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051930c8-bcb5-413d-9f93-313bb9612f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:25.554144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-051930c8-bcb5-413d-9f93-313bb9612f53 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:25.555332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-051930c8-bcb5-413d-9f93-313bb9612f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:25.624558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 517/1015] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:25 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:25.648645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee247c20-630a-4239-abbd-35350f0f1bd1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:25.745927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee247c20-630a-4239-abbd-35350f0f1bd1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:25.779234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:25.779904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:25.780184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:25.780457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:25.781192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:25.782596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:25.787000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc85ef-9835-4634-98dd-ab69a5b1bbcd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:25.787291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc85ef-9835-4634-98dd-ab69a5b1bbcd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:25.787575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc85ef-9835-4634-98dd-ab69a5b1bbcd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:25.788974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 518/1016] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:25.795271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:25.795565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:25.803432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:25.813852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:25.815272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:25.857526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 499/1017] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:25 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:00:25.898397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 519/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:25.925075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.033720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f656b-b364-46f1-9dd5-b6fb6ac3934d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.070568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.071374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.071653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.071931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.081767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:26.089213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:00:26.090732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 500/1019] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Apr 11 13:00:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:26.096410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.192301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f1bd-e8e4-4fcb-9410-a58e2a99bfe8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.224485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.225156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.225434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.225705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.226729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:26.227029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.228395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17779-288e-4c3c-b5a4-eac8bb74dccf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.241722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 520/1020] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:26.243309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.341965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f45dec-386e-44a7-912a-e52b9a36a41c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.371661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efc1f-2be9-4d68-85fa-af03ff9c3476 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.371945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efc1f-2be9-4d68-85fa-af03ff9c3476 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.372224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efc1f-2be9-4d68-85fa-af03ff9c3476 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.373633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 521/1021] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:26.378710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.378998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.379172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.379302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.379923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.380652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.380927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.398809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:26.398991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.399987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:26.400407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.419657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:26.421028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 501/1022] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:26.426608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.467086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 522/1023] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:26.492172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.529368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a04ca-685a-4e88-b9b6-f51983e093d7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.562882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.564265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.564756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.565218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.565939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:26.566275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.567644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.579410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 502/1024] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:26.584839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.589612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b33ea-f199-403e-b62f-fa02d21fa42b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.623364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.624161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.624443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.624718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.625924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.627393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.629179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 523/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:26.634703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.681508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262cc5a-cc2a-4361-ba92-f7fc1e4438bc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.714400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.715190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.715466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.715740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.722807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.724203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.733179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e01b9-1bcf-49e5-b140-fdbc88b32aba None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.739169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:00:26.740718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 503/1026] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:26.746330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:26.766879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.767544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.767826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.768097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.768795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.770258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.843807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de386b-376a-4d52-afb5-cf0590c6b93f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:26.870621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 524/1027] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:26 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:00:26.880308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:26.881005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:26.881289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:26.881565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:26.882475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:26.882786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:26.884364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:26.904836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 504/1028] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:26.910750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:27.017542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a879aa-32e3-4c11-b795-ec42b8d6f061 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:27.055354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:27.056012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:27.056295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:27.056570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:27.126021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:27.127506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:27.220944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 525/1029] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 13:00:27.227177 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:27.323748 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2791d-fe22-49db-bdd1-2a23aa9380d9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:27.355467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:27.356253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:27.356530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:27.356802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:27.366328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:27.367767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:27.384269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:27.390644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 505/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:27.392176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:27.487479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b722c-b45e-409c-b246-186dc595efdd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:27.519486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:27.520150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:27.520433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:27.520707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:27.521429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:27.521732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:27.523108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:27.538619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 526/1031] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:27.540164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:27.637116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7a1a-e4d3-4e7a-a73e-89201bacf403 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:27.669534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:27.670359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:27.670662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:27.670943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:27.677674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:27.679173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:27.692313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:27.698705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 506/1032] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:27.700360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:27.797904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd68a1-92f4-4be4-9e3b-7cc69705b2d8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:27.831400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:27.832073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:27.832359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:27.832635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:27.833429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:27.833738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:27.835188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836201b9-0d93-42e5-8190-a3997b163f5a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:27.854086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 527/1033] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:27.856408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:27.959137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ad354-c437-42cf-aba8-cfa9714e2503 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:27.996185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:27.996841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:27.997121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:27.997396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:27.998252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] RBAC: Adding query filter params (role.id=983bce756b8a46ae9ba7241136be1f65, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=b02c83e7079e45e7b8ae4b49ac15f4d2) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:27.998564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:28.000020 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c15a6-554d-4ff9-bd8e-722044180eb7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:28.005559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 507/1034] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:27 2022] GET /identity/v3/role_assignments?user.id=b02c83e7079e45e7b8ae4b49ac15f4d2&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=983bce756b8a46ae9ba7241136be1f65 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:28.230812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32530ca-87c8-4124-af20-1f6e11358c14 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:28.231012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32530ca-87c8-4124-af20-1f6e11358c14 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:28.231290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32530ca-87c8-4124-af20-1f6e11358c14 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:28.232677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 528/1035] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:28.237741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:28.238142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:28.238503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:28.255988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:28.257173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:28.334143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 508/1036] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:28.355019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32530ca-87c8-4124-af20-1f6e11358c14 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:28.454571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32530ca-87c8-4124-af20-1f6e11358c14 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:28.488170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:28.488892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:28.489174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:28.489451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] PATH_INFO: `/v3/services/image` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:28.490133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:28.491500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:28.503009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 13:00:28.508988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 529/1037] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Apr 11 13:00:28 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:28.510203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:28.607881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411492-1564-42c6-82f6-77ed3c787232 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:28.644823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:28.645605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:28.645768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:28.646041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:28.646799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] RBAC: Adding query filter params (name=image) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:28.647110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:28.648478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:28.658183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 509/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:28.659869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:28.756730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafd51-1652-4726-8e42-390869d37c7b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:28.789366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:28.790035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:28.790343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:28.790617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:28.791322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] RBAC: Adding query filter params (type=image) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:28.791625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:28.793604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:28.798807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 530/1039] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:28.804415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:28.904263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55401e-cfe4-45d1-882d-95e21b39d713 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:28.937204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:28.937860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:28.938161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:28.938438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:28.939222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] RBAC: Adding query filter params (interface=public, service_id=f77f72a058254995a5e15eab51ef404f, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:28.939528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:28.940882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf803d-5b4e-4b48-b976-9dc91d56393f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:28.951017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 510/1040] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 13:00:28 2022] GET /identity/v3/endpoints?service_id=f77f72a058254995a5e15eab51ef404f&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:28.952522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:29.049872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223891ef-97bf-421a-977b-dade86cc72ef None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:29.082878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bac53-3e1f-4ce0-b3fa-ee658f2a4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:29.083546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bac53-3e1f-4ce0-b3fa-ee658f2a4ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:29.083827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bac53-3e1f-4ce0-b3fa-ee658f2a4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:29.084102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bac53-3e1f-4ce0-b3fa-ee658f2a4ca7 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:29.084781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bac53-3e1f-4ce0-b3fa-ee658f2a4ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:29.086162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bac53-3e1f-4ce0-b3fa-ee658f2a4ca7 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:29.102145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 531/1041] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:00:28 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:00:29.252473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a5e3-5680-4789-8c23-bc9360085271 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:29.252803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a5e3-5680-4789-8c23-bc9360085271 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:29.253042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a5e3-5680-4789-8c23-bc9360085271 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:29.254656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 511/1042] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:29.260111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:29.260402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:29.261235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:29.278710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:29.279903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:29.346722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 532/1043] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:29.373252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46a5e3-5680-4789-8c23-bc9360085271 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:29.477424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46a5e3-5680-4789-8c23-bc9360085271 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:29.510364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ff5f1-4e3e-48ff-8527-1e6fd42dc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:29.511175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff5f1-4e3e-48ff-8527-1e6fd42dc666 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:29.511438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff5f1-4e3e-48ff-8527-1e6fd42dc666 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:29.511718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff5f1-4e3e-48ff-8527-1e6fd42dc666 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:29.512894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ff5f1-4e3e-48ff-8527-1e6fd42dc666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:29.514402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ff5f1-4e3e-48ff-8527-1e6fd42dc666 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:29.516211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 512/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:29.521789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:29.617324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139e133-4e2a-4db9-8b84-b5b35774429d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:29.649547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0d545-0f63-4d97-9276-2bd5be155a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:29.650245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0d545-0f63-4d97-9276-2bd5be155a02 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:29.650531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0d545-0f63-4d97-9276-2bd5be155a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:29.650804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0d545-0f63-4d97-9276-2bd5be155a02 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:29.652028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0d545-0f63-4d97-9276-2bd5be155a02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:29.653440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0d545-0f63-4d97-9276-2bd5be155a02 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:29.753401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 533/1045] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 13:00:29 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:00:30.297388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5514a-f5a0-442a-9a8b-4c79d9737565 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:30.297911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5514a-f5a0-442a-9a8b-4c79d9737565 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:30.297911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5514a-f5a0-442a-9a8b-4c79d9737565 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:30.299374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 513/1046] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:30.304544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:30.304941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:30.305100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:30.321319 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:30.322530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:30.389910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 534/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:30.412044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5514a-f5a0-442a-9a8b-4c79d9737565 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:30.508521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5514a-f5a0-442a-9a8b-4c79d9737565 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:30.542330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:30.543136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:30.543415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:30.543684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:30.553735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:30.561384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:00:30.565922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 514/1048] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Apr 11 13:00:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:30.570227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:30.667300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee3c9-ab0e-4f47-ae82-7b0833c29095 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:30.700048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:30.700724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:30.701003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:30.701276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:30.702054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:30.702390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:30.703812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:30.717029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 535/1049] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:00:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:30.718189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:30.814820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc67b2-956e-4925-aad8-eeac01d0299f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:30.847460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:30.848256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:30.848535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:30.848806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:30.859888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:30.861348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:30.878352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:30.879730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 515/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:30.885185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:30.985042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f286560-9f4f-4a45-9914-62c423ae786a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.017175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.017842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.018155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.018426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.019150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:31.019457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.020823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.038319 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 536/1051] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:31.040160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.141428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74503e-6f33-4745-bcc3-8830d0268142 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.172941 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.173738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.174019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.174325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.182126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.184121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.196916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:00:31.198692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 516/1052] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:31.204170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.300242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f12fb9-86ff-4e74-b8ed-f76eebc734dd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.333308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.334034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.334313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.334571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.335407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:31.335715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.337153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73824-4531-43a9-92bf-ea21c5b72e57 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.355175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 537/1053] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:31.360998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.420268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4a9c-d56d-4c1e-819b-7110cbbb6974 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.420560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4a9c-d56d-4c1e-819b-7110cbbb6974 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.420740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa4a9c-d56d-4c1e-819b-7110cbbb6974 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.422300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 538/1054] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:31.426917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.427207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.427487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.444051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:31.445422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:31.469640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2805f1-cf5e-47d6-83a9-7914c559ea8f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.502626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.503536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.503813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.504080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.513278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 539/1055] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:31.515610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.517049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.537019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.538176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:31.544244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 517/1056] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:31.545768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.634717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db544-f7d5-4293-a414-d991aa9a26e0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.645845 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ee03b-b8df-469c-a77b-f294d777945c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.668410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.669205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.669487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.669768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.670539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.671820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.677740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.678431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.678718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.678992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.679713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:31.680019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.681380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.683387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 13:00:31.684614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 540/1057] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:31.690564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.695507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 518/1058] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:31.702298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.794544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979f92c-0fd1-45c4-830f-e89216248ad5 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.801807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c268fc-3a42-4fc0-a1b8-8d77ba7446d1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.833795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.834489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.834771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.834974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.835105 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.835738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:31.835833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.836028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.836137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.836296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.837373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.843505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.843842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 541/1059] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:31.847572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.849297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.862034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:31.868104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 519/1060] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:31.868876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:31.947265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32c125-4bfb-4db8-aaed-af95e462d1f6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.969714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8dd1a-49cc-4d19-b35b-6175d019377c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:31.980700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:31.981444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:31.981729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:31.982006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:31.983023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] RBAC: Adding query filter params (type=image) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:31.983334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:31.984695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:31.989617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 542/1061] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:31.995165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:32.005680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:32.006376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.006657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.006934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.007725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:32.008035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:32.009469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:32.021854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 520/1062] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:32.028173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:32.100530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc8b87-226e-4162-bb8a-1d1858723bfe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:32.125205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0241d3-a5c2-4984-a8c7-e8db202cf253 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:32.133809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02de0-0c2f-4705-b54a-f9003586d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:32.134499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02de0-0c2f-4705-b54a-f9003586d28c None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.134774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02de0-0c2f-4705-b54a-f9003586d28c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.135044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02de0-0c2f-4705-b54a-f9003586d28c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.135827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02de0-0c2f-4705-b54a-f9003586d28c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:32.137182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02de0-0c2f-4705-b54a-f9003586d28c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:32.157527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:32.164367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.164367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.164367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/b02c83e7079e45e7b8ae4b49ac15f4d2/roles/983bce756b8a46ae9ba7241136be1f65` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.164367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=b02c83e7079e45e7b8ae4b49ac15f4d2, role_id=983bce756b8a46ae9ba7241136be1f65)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:32.164367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:32.234299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 543/1063] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:00:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:00:32.235535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9a47-6f0d-46e2-97c2-5d8b9d11510c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.235825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9a47-6f0d-46e2-97c2-5d8b9d11510c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.236106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9a47-6f0d-46e2-97c2-5d8b9d11510c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.237421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 544/1064] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:32.243120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.243344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.243727 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.246281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 521/1065] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:00:32 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/b02c83e7079e45e7b8ae4b49ac15f4d2/roles/983bce756b8a46ae9ba7241136be1f65 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:00:32.263321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:32.269915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:32.434138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 545/1066] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:32.452244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:32.553481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416d73-e599-4246-acb2-e2e63eade9ac None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:32.592708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:32.593882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.594410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.594904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.606146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:32.613371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:00:32.615167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 522/1067] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:32.621504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:32.718132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a0d4-0adc-4bac-8bff-3f206b9d274e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:32.750855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:32.751530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.751814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.752093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:32.752842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:32.753152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:32.754551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:32.763305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 546/1068] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:32.768771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:32.865915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c14a55-9023-455c-bd9d-9d9e0c78ebe2 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:32.898483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:32.899400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:32.899686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:32.899961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] PATH_INFO: `/v3/users/e8aef59b6cd148279e3e5f05a97068ee` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:33.037557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] RBAC: Authorizing `identity:get_user(user_id=e8aef59b6cd148279e3e5f05a97068ee)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:33.039019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:33.040759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 523/1069] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:32 2022] GET /identity/v3/users/e8aef59b6cd148279e3e5f05a97068ee => generated 285 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:33.047008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:33.144261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddee1-a655-48c6-aa46-6cf1f4d6ce6c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:33.176903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:33.177550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:33.177833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:33.178121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:33.241818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:33.243281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:33.399882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 547/1070] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:33.402409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:33.500446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab71dd-0838-4c5c-adb1-8e89d568da90 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:33.533232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8f08-879c-4821-89ca-392307190f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:33.534087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8f08-879c-4821-89ca-392307190f01 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:33.534533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8f08-879c-4821-89ca-392307190f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:33.534752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8f08-879c-4821-89ca-392307190f01 None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:33.535828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8f08-879c-4821-89ca-392307190f01 None admin] RBAC: Authorizing `identity:get_project(project_id=46bd3c6c0658471fbcf8413f68be74e7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:33.537247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8f08-879c-4821-89ca-392307190f01 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:33.539136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 524/1071] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:00:33 2022] GET /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:33.545598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:33.642177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097865-5636-40c4-a081-3302a3e19dfe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:33.675290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:33.675871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:33.676154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:33.676428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:33.677250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=46bd3c6c0658471fbcf8413f68be74e7, user.id=e8aef59b6cd148279e3e5f05a97068ee) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:33.677561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:33.679006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5df9e-ba3b-4279-83b1-97685c794c19 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:33.684504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 548/1072] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:33 2022] GET /identity/v3/role_assignments?user.id=e8aef59b6cd148279e3e5f05a97068ee&scope.project.id=46bd3c6c0658471fbcf8413f68be74e7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:34.581549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb838554-cd4c-491a-a8ec-289b393e6377 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:34.583606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb838554-cd4c-491a-a8ec-289b393e6377 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:34.583606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb838554-cd4c-491a-a8ec-289b393e6377 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:34.584104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 525/1073] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:34.589397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:34.589800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:34.589971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:34.606942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:34.608118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:34.649970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03349b-5ad2-462e-a164-8390b0c2137d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:34.650302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03349b-5ad2-462e-a164-8390b0c2137d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:34.650658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03349b-5ad2-462e-a164-8390b0c2137d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:34.653863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 526/1074] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:34.659442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:34.659717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:34.659992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:34.676546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:34.677044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 549/1075] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:34.679203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:34.702506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:34.745890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 527/1076] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:34.768080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:34.803193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b76b-5f58-43d2-9919-73501f75fdf2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:34.837120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:34.837943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:34.838263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:34.839046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:34.849228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:34.857458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:00:34.859060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 550/1077] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Apr 11 13:00:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:34.864644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:34.871922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5065d0-1bdb-4b74-aa53-5e145420c5cd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:34.907430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:34.908031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:34.908312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:34.908582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:34.965284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21c26-de41-4870-b0d4-a2acc8421eb6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:34.975331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:34.977039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.005762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.007276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.007771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.008201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.009313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:35.010506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.011939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.019910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 551/1078] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:00:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:35.025328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.074320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 528/1079] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 13:00:35.081393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.136075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faebcc-aeea-4798-b50e-5e0621a4ba01 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.169516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.170281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.170567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.170844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.177299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bf4db-a844-4628-bc05-63f8606ac552 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.181271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.182901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.199747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:35.201152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 552/1080] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:35.206783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.212109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.212908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.213187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.213459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.225058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.226806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.242921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:35.244293 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 529/1081] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:35.250080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.313928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b3736-1f4a-4b90-9f14-e980bd7ee529 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.346949 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe44b1e-ef45-4604-b143-af4f035a3e8b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.348735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.349409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.349687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.349963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.350731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:35.351285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.352641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.371234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 553/1082] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:35.372905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.386230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.386832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.387274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.387574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.388670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:35.389123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.390524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.403206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 530/1083] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:35.481300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85137fdf-de57-4a31-b660-b9ff1dbf5ab9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.517877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.518725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.519005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.519281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.527202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.528664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.543767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:00:35.545255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 554/1084] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:35.551224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.657744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2fc83-5a4b-47d8-bac7-7f7fdf9b89ed None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.692912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.693609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.693888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.694220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.695110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:35.695417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.696829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4175-30e2-4719-ab3d-da6fa48b4dd2 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.715243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 531/1085] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:35.721310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:35.815312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057113b1-6bde-4914-ac28-73bbb666f5fb None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:35.848904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:35.849554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.849840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.850128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.914380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:35.915841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:35.957538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f34fb-faa6-4cf4-ae07-d1bc74f8112d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.957906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f34fb-faa6-4cf4-ae07-d1bc74f8112d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.958278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f34fb-faa6-4cf4-ae07-d1bc74f8112d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.959745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 532/1086] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:00:35.965226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:35.965504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:35.965773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:35.981684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:35.982893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:36.008129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 555/1087] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:36.014268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.047308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 533/1088] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:36.070035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.105945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680e50-6bc0-414d-8226-e277892ab134 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.138727 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.139515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.139793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.140062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.149509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.150946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.163867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a42965-e31c-4d3d-9085-8fccdfa76278 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.167126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:00:36.168319 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 556/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:36.173919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.197373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.199280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.199566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.199846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.209560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:36.217340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:00:36.218589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 534/1090] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:36.225822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.269655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae09df-e584-4f4f-8d47-badea26553bd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.302150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.302815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.303095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.303371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.304097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:36.304403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.305780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.317281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 557/1091] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:36.320927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd917e-4fb5-472b-9f4d-4ed801e21eb9 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.322976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.354094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.354894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.355165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.355437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.356179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:36.356482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.357835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.365712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 535/1092] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:36.371858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.420147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192024e-ef35-483e-a540-0dffb2b4c8dd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.451587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.452375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.452657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.452964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.459373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.460793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.464694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8bde3-d776-49dd-aa0e-209f00da47bf None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.474709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:00:36.475921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 558/1093] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:00:36.482053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.496254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.497118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.497394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.497663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] PATH_INFO: `/v3/users/e8aef59b6cd148279e3e5f05a97068ee` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.498906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] RBAC: Authorizing `identity:get_user(user_id=e8aef59b6cd148279e3e5f05a97068ee)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.500320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.502076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 536/1094] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/users/e8aef59b6cd148279e3e5f05a97068ee => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:36.507415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.575124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14f41-389d-4ce7-a563-eb5c97d9e6ca None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.602013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbe867-880d-4773-9dd8-c6a2fdfe0e73 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.607506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.608154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.608434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.608716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.609490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:36.609792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.611231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.622298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 559/1095] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:36.628160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.633362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.634255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.634536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.634808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.636644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=46bd3c6c0658471fbcf8413f68be74e7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.638070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.639805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 537/1096] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:36.645406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:36.721246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea707-717e-4bba-af72-c3b12afba3b2 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.739019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084a0ab-5518-4a2a-a26d-5ce57ce99cd8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:36.752443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.753092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.753369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.753641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.754490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] RBAC: Adding query filter params (role.id=983bce756b8a46ae9ba7241136be1f65, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=b02c83e7079e45e7b8ae4b49ac15f4d2) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:36.754795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.756191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2092-34fa-4507-9dd5-d161f2d9a626 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.762743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 560/1097] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:36 2022] GET /identity/v3/role_assignments?user.id=b02c83e7079e45e7b8ae4b49ac15f4d2&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=983bce756b8a46ae9ba7241136be1f65 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:36.771571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1e63b-74e5-4a0b-87b8-1ee5a4bce1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:36.772491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1e63b-74e5-4a0b-87b8-1ee5a4bce1e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:36.772774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1e63b-74e5-4a0b-87b8-1ee5a4bce1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:36.773053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1e63b-74e5-4a0b-87b8-1ee5a4bce1e3 None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7/users/e8aef59b6cd148279e3e5f05a97068ee/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:36.775190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1e63b-74e5-4a0b-87b8-1ee5a4bce1e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=46bd3c6c0658471fbcf8413f68be74e7, user_id=e8aef59b6cd148279e3e5f05a97068ee, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:36.777331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1e63b-74e5-4a0b-87b8-1ee5a4bce1e3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:36.857153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 538/1098] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:00:36 2022] PUT /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7/users/e8aef59b6cd148279e3e5f05a97068ee/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:00:39.131349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b788640-d7e1-44fe-b337-3f618ccb1c26 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:39.131874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b788640-d7e1-44fe-b337-3f618ccb1c26 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:39.131967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b788640-d7e1-44fe-b337-3f618ccb1c26 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:39.133303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 561/1099] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:39.139050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:39.139467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:39.139599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:39.156140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:39.157301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:39.219282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 539/1100] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:39.243798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b788640-d7e1-44fe-b337-3f618ccb1c26 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:39.341906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b788640-d7e1-44fe-b337-3f618ccb1c26 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:39.375710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:39.376536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:39.376815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:39.377086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:39.388026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:00:39.394995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:00:39.396373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 562/1101] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:00:39.402318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:39.494230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c42c-7869-46c2-a3bd-0d77940797a7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:39.525660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:39.526479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:39.526836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:39.527107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:39.527839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:39.528139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:39.529485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:39.537036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 540/1102] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:39.543367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:39.638598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b60bd9-88e1-4e0e-9fd0-eb527d60bbdf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:39.669822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:39.670713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:39.670997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:39.671272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] PATH_INFO: `/v3/users/e8aef59b6cd148279e3e5f05a97068ee` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:39.672442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=e8aef59b6cd148279e3e5f05a97068ee)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:39.673849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:39.675496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 563/1103] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:39 2022] GET /identity/v3/users/e8aef59b6cd148279e3e5f05a97068ee => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:39.681209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:39.775336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dee1fe-440e-43c0-a4ab-75c1154ed67f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:39.806355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:39.806986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:39.808057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:39.808418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:39.870914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:39.872339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:39.963064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 541/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:39.968972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:40.063081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a49fef-b169-4d7a-bf2d-46dc82b60ff3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:40.094292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e848d-2b02-4312-a570-19077fd3e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:40.095136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e848d-2b02-4312-a570-19077fd3e90c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:40.095417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e848d-2b02-4312-a570-19077fd3e90c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:40.095694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e848d-2b02-4312-a570-19077fd3e90c None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:40.096858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e848d-2b02-4312-a570-19077fd3e90c None admin] RBAC: Authorizing `identity:get_project(project_id=46bd3c6c0658471fbcf8413f68be74e7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:40.098298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e848d-2b02-4312-a570-19077fd3e90c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:40.099990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 564/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:00:39 2022] GET /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:40.106364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:40.200604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6ea86-c24c-47cf-9697-ce32a97ab0c6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:40.232944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:40.233519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:40.233795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:40.234064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:40.234919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=46bd3c6c0658471fbcf8413f68be74e7, user.id=e8aef59b6cd148279e3e5f05a97068ee) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:40.235225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:40.236629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14ae69-11c2-4788-a6f5-49a9117699e9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:40.242261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 542/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:40 2022] GET /identity/v3/role_assignments?user.id=e8aef59b6cd148279e3e5f05a97068ee&scope.project.id=46bd3c6c0658471fbcf8413f68be74e7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:42.533736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae779-d217-4568-af0d-f1359054933a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:42.534301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae779-d217-4568-af0d-f1359054933a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:42.534301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae779-d217-4568-af0d-f1359054933a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:42.535695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 565/1107] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:42.540751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:42.541163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:42.541300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:42.558419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:42.559571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:42.623947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 543/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:42.648868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae779-d217-4568-af0d-f1359054933a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:42.747077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae779-d217-4568-af0d-f1359054933a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:42.778123 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83206c8-433a-4615-849c-c34029694878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:42.778913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83206c8-433a-4615-849c-c34029694878 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:42.779195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83206c8-433a-4615-849c-c34029694878 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:42.779469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83206c8-433a-4615-849c-c34029694878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:42.780633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83206c8-433a-4615-849c-c34029694878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:42.782044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83206c8-433a-4615-849c-c34029694878 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:42.783688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 566/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:42.789550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:42.882586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccf524-6e23-472a-bde5-55dc4eeeb881 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:42.914330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548045d-3130-4366-b4eb-f09297e8f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:42.914922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548045d-3130-4366-b4eb-f09297e8f645 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:42.915199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548045d-3130-4366-b4eb-f09297e8f645 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:42.915468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548045d-3130-4366-b4eb-f09297e8f645 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:42.916163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548045d-3130-4366-b4eb-f09297e8f645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:42.917817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548045d-3130-4366-b4eb-f09297e8f645 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:43.009257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 544/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 13:00:42 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:45.329489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14affa4-51f7-4ecf-8389-dec5fd4c738f None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:45.330049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14affa4-51f7-4ecf-8389-dec5fd4c738f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:45.330049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14affa4-51f7-4ecf-8389-dec5fd4c738f None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:45.331440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 567/1111] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:45.336569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:45.336990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:45.337218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:45.353693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:45.354898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:45.421974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 545/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:45.448326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14affa4-51f7-4ecf-8389-dec5fd4c738f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:45.601695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14affa4-51f7-4ecf-8389-dec5fd4c738f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:45.633467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:45.634334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:45.634615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:45.634884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] PATH_INFO: `/v3/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:45.636366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] RBAC: Authorizing `identity:get_role(role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:45.637696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:45.639089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 568/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:45 2022] GET /identity/v3/roles/b51956c831c84838aece85c3cb553f84 => generated 223 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:45.644832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:45.736331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3c09-4189-4da7-8ce5-ee2ef4f798a1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:45.767882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:45.768728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:45.769001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:45.769269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] PATH_INFO: `/v3/users/f665e9ab23b84382b969b1eb732af68f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:45.781516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] RBAC: Authorizing `identity:get_user(user_id=f665e9ab23b84382b969b1eb732af68f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:45.782961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:45.784578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 546/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:45 2022] GET /identity/v3/users/f665e9ab23b84382b969b1eb732af68f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:45.790218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:45.883238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da249-4221-48cc-98ea-409d1701c625 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:45.914592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3811197-4758-444c-8f35-409354310272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:45.915223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3811197-4758-444c-8f35-409354310272 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:45.915502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3811197-4758-444c-8f35-409354310272 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:45.915773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3811197-4758-444c-8f35-409354310272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:45.978322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3811197-4758-444c-8f35-409354310272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:45.980388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3811197-4758-444c-8f35-409354310272 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:46.195487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 569/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:46.201683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:46.296475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9b35-7d22-4262-8e6d-8345ab54a382 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:46.328031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb427044-de7f-481c-94e5-825a3b55f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:46.328872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427044-de7f-481c-94e5-825a3b55f206 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:46.329148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427044-de7f-481c-94e5-825a3b55f206 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:46.329417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427044-de7f-481c-94e5-825a3b55f206 None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:46.330588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb427044-de7f-481c-94e5-825a3b55f206 None admin] RBAC: Authorizing `identity:get_project(project_id=46bd3c6c0658471fbcf8413f68be74e7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:46.331997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb427044-de7f-481c-94e5-825a3b55f206 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:46.333667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 547/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:00:46 2022] GET /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:46.340029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3811197-4758-444c-8f35-409354310272 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:46.431582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3811197-4758-444c-8f35-409354310272 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:46.462594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:46.463177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:46.463490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:46.463757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:46.464586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] RBAC: Adding query filter params (role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=46bd3c6c0658471fbcf8413f68be74e7, user.id=f665e9ab23b84382b969b1eb732af68f) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:46.464887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:46.466317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996c76-465c-432f-9b7d-6606ed7d63ca None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:46.471465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 570/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:46 2022] GET /identity/v3/role_assignments?user.id=f665e9ab23b84382b969b1eb732af68f&scope.project.id=46bd3c6c0658471fbcf8413f68be74e7&role.id=b51956c831c84838aece85c3cb553f84 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:00:48.716947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769aa5-7a49-4ceb-912a-c33cb7dcae5b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:48.717443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769aa5-7a49-4ceb-912a-c33cb7dcae5b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:48.717443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769aa5-7a49-4ceb-912a-c33cb7dcae5b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:48.718860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 548/1118] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:48.726036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:48.726717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:48.726867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:48.742920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:48.744073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:48.805818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 571/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:48.828864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769aa5-7a49-4ceb-912a-c33cb7dcae5b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:48.923181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769aa5-7a49-4ceb-912a-c33cb7dcae5b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:48.955052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:48.955887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:48.956231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:48.956510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] PATH_INFO: `/v3/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:48.957950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] RBAC: Authorizing `identity:get_role(role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:48.959327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:48.960672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 549/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:48 2022] GET /identity/v3/roles/b51956c831c84838aece85c3cb553f84 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:48.966902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:49.059311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504db28d-7e55-414d-aa2d-788c6ae0d6c4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:49.091270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:49.092135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:49.092412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:49.092680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] PATH_INFO: `/v3/users/f665e9ab23b84382b969b1eb732af68f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:49.093857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=f665e9ab23b84382b969b1eb732af68f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:49.095295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:49.096920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 572/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:48 2022] GET /identity/v3/users/f665e9ab23b84382b969b1eb732af68f => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:49.102944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:49.195520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecdb-5841-427b-9472-ca965831d5fc None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:49.228544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdadeca-df1b-4443-b579-6a76f009dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:49.229382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdadeca-df1b-4443-b579-6a76f009dc71 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:49.229654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdadeca-df1b-4443-b579-6a76f009dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:49.229927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdadeca-df1b-4443-b579-6a76f009dc71 None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:49.231115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdadeca-df1b-4443-b579-6a76f009dc71 None admin] RBAC: Authorizing `identity:get_project(project_id=46bd3c6c0658471fbcf8413f68be74e7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:49.232535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdadeca-df1b-4443-b579-6a76f009dc71 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:49.234247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 550/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:00:49 2022] GET /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:49.241395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:49.334591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3b2f-f168-4b48-8d73-3c78063f3ab3 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:49.366545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e325-9f0d-4c15-862e-e91579570253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:49.367423 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e325-9f0d-4c15-862e-e91579570253 None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:49.367704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e325-9f0d-4c15-862e-e91579570253 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:49.367999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e325-9f0d-4c15-862e-e91579570253 None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7/users/f665e9ab23b84382b969b1eb732af68f/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:49.370252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e325-9f0d-4c15-862e-e91579570253 None admin] RBAC: Authorizing `identity:create_grant(project_id=46bd3c6c0658471fbcf8413f68be74e7, user_id=f665e9ab23b84382b969b1eb732af68f, role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:49.371666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e325-9f0d-4c15-862e-e91579570253 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:49.444234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 573/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:00:49 2022] PUT /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7/users/f665e9ab23b84382b969b1eb732af68f/roles/b51956c831c84838aece85c3cb553f84 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:00:51.694316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff18466-45cf-4228-b45d-3ce582df7d97 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:51.694819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff18466-45cf-4228-b45d-3ce582df7d97 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:51.694819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff18466-45cf-4228-b45d-3ce582df7d97 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:51.696170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 551/1124] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:51.701873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:51.702318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:51.702437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:51.718986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:51.720139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:51.784016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 574/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:00:51.808505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff18466-45cf-4228-b45d-3ce582df7d97 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:51.904272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff18466-45cf-4228-b45d-3ce582df7d97 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:51.936008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:51.936841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:51.937120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:51.937390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] PATH_INFO: `/v3/roles/b51956c831c84838aece85c3cb553f84` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:51.938897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] RBAC: Authorizing `identity:get_role(role_id=b51956c831c84838aece85c3cb553f84)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:51.940246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:51.941619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 552/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:51 2022] GET /identity/v3/roles/b51956c831c84838aece85c3cb553f84 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:51.947270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:52.038083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dd24e-d3f5-407c-8404-94b0c8d6f93b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:52.069769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:52.070644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:52.070918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:52.071183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] PATH_INFO: `/v3/users/f665e9ab23b84382b969b1eb732af68f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:52.072339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] RBAC: Authorizing `identity:get_user(user_id=f665e9ab23b84382b969b1eb732af68f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:52.073826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:52.075442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 575/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:00:51 2022] GET /identity/v3/users/f665e9ab23b84382b969b1eb732af68f => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:52.080974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:52.173724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f121-c8b1-40b3-af84-8be645dbc0a6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:52.205205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:52.205780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:52.206060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:52.206362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:52.268589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:52.270011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:52.362225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 553/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:00:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:00:52.367981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:52.460698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db9802-d8ce-48ab-a0c9-62097b3acb22 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:52.492162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a327c4-3257-43d1-b869-5013a6ae3a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:52.493007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a327c4-3257-43d1-b869-5013a6ae3a5e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:52.493286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a327c4-3257-43d1-b869-5013a6ae3a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:52.493558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a327c4-3257-43d1-b869-5013a6ae3a5e None admin] PATH_INFO: `/v3/projects/46bd3c6c0658471fbcf8413f68be74e7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:52.494783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a327c4-3257-43d1-b869-5013a6ae3a5e None admin] RBAC: Authorizing `identity:get_project(project_id=46bd3c6c0658471fbcf8413f68be74e7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:52.496184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a327c4-3257-43d1-b869-5013a6ae3a5e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:52.497865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 576/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:00:52 2022] GET /identity/v3/projects/46bd3c6c0658471fbcf8413f68be74e7 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:52.503984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:52.595256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482d4da-ce55-4356-a107-dfdd10befd41 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:52.626674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:52.627306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:52.627583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:52.627855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:52.628674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] RBAC: Adding query filter params (role.id=b51956c831c84838aece85c3cb553f84, scope.project.id=46bd3c6c0658471fbcf8413f68be74e7, user.id=f665e9ab23b84382b969b1eb732af68f) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:00:52.628978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:52.630403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb699ec9-4fde-42e3-a1fe-50cd578f6574 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:52.636097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 554/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:00:52 2022] GET /identity/v3/role_assignments?user.id=f665e9ab23b84382b969b1eb732af68f&scope.project.id=46bd3c6c0658471fbcf8413f68be74e7&role.id=b51956c831c84838aece85c3cb553f84 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:54.923444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5018f7-9c9c-4f68-88d0-7812c0424bd6 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:54.923971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5018f7-9c9c-4f68-88d0-7812c0424bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:54.923971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5018f7-9c9c-4f68-88d0-7812c0424bd6 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:54.925353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 577/1131] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:54.930480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:54.930923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:54.931032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:54.947692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:54.949557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:55.011287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 555/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:55.035157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5018f7-9c9c-4f68-88d0-7812c0424bd6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:55.129292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5018f7-9c9c-4f68-88d0-7812c0424bd6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:55.163475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ae827-0180-4ee8-aa5a-460e25aeb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:55.164249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae827-0180-4ee8-aa5a-460e25aeb5ca None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:55.164572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae827-0180-4ee8-aa5a-460e25aeb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:55.164890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae827-0180-4ee8-aa5a-460e25aeb5ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:55.166051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae827-0180-4ee8-aa5a-460e25aeb5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:55.168004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae827-0180-4ee8-aa5a-460e25aeb5ca None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:55.169591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 578/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:55.175399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:55.269137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3de5-d95c-43ce-9a1a-c74b116de0b2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:55.301575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae96b4-6bf3-4c06-a5e2-e0b59430df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:55.302247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae96b4-6bf3-4c06-a5e2-e0b59430df63 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:55.302527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae96b4-6bf3-4c06-a5e2-e0b59430df63 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:55.302801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae96b4-6bf3-4c06-a5e2-e0b59430df63 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:55.303512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae96b4-6bf3-4c06-a5e2-e0b59430df63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:55.304925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae96b4-6bf3-4c06-a5e2-e0b59430df63 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:55.418209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 556/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:00:55 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:00:57.774362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175745-59f2-43b7-9c21-cfe2cb840317 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:57.774875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175745-59f2-43b7-9c21-cfe2cb840317 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:57.774963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175745-59f2-43b7-9c21-cfe2cb840317 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:57.776607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 579/1135] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:00:57.782400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:57.782968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:57.783060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:57.800512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:00:57.801695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:00:57.868878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 557/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:00:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:00:57.895482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175745-59f2-43b7-9c21-cfe2cb840317 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:57.994326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175745-59f2-43b7-9c21-cfe2cb840317 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:58.028333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a1a60-2e6a-411d-820e-22942d2aa357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:58.029045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a1a60-2e6a-411d-820e-22942d2aa357 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:58.029329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a1a60-2e6a-411d-820e-22942d2aa357 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:58.029780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a1a60-2e6a-411d-820e-22942d2aa357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:58.030798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a1a60-2e6a-411d-820e-22942d2aa357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:58.032217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a1a60-2e6a-411d-820e-22942d2aa357 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:58.033843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 580/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:00:58.040080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:00:58.143021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f53df-4c81-40cf-b682-651ad4e8c6f9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:00:58.176353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364dbf1-e63f-44b9-87da-c2483e56927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:00:58.177014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364dbf1-e63f-44b9-87da-c2483e56927e None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:00:58.177292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364dbf1-e63f-44b9-87da-c2483e56927e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:00:58.177564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364dbf1-e63f-44b9-87da-c2483e56927e None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:00:58.178298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364dbf1-e63f-44b9-87da-c2483e56927e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:00:58.179738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364dbf1-e63f-44b9-87da-c2483e56927e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:00:58.262032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 558/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 13:00:58 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:01:00.597210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616da3c-035b-48c9-8492-67c56525a330 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:00.597713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616da3c-035b-48c9-8492-67c56525a330 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:00.597798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616da3c-035b-48c9-8492-67c56525a330 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:00.599180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 581/1139] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:00.604975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:00.605376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:00.605525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:00.622168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:00.623336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:00.685169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 559/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:00.709177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616da3c-035b-48c9-8492-67c56525a330 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:00.804981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616da3c-035b-48c9-8492-67c56525a330 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:00.837373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:00.838184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:00.838992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:00.839237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:00.849020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:01:00.856713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:01:00.857879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 582/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:00.864135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:00.956957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea9e8-7b9d-49b2-a210-63b25eef44f2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:00.989250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:00.989902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:00.990205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:00.990476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:00.991242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:00.991543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:00.992896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:01.000546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 560/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:01.006222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:01.098833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ada2-9d3b-4d93-b4d4-9f5471c1e4fd None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:01.130361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:01.131205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:01.131485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:01.131758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] PATH_INFO: `/v3/users/adfaf97fd5ce444d99e53df98c8baa41` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:01.144533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=adfaf97fd5ce444d99e53df98c8baa41)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:01.145939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:01.147598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 583/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:01:01 2022] GET /identity/v3/users/adfaf97fd5ce444d99e53df98c8baa41 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:01.153423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:01.247344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d99d0-4783-4a60-a4ea-4dad06c2a10a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:01.278305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:01.278930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:01.279209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:01.280556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:01.342772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:01.344191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:01.436739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 561/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:01:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:01:01.442633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:01.533939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c013-c232-42db-bb25-95c185d59bf9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:01.565810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac8498-93c4-46c2-8050-b919f7542d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:01.566680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac8498-93c4-46c2-8050-b919f7542d2b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:01.566961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac8498-93c4-46c2-8050-b919f7542d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:01.567234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac8498-93c4-46c2-8050-b919f7542d2b None admin] PATH_INFO: `/v3/projects/db873dfa413a4f2db35e5765d81c96c0` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:01.568402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac8498-93c4-46c2-8050-b919f7542d2b None admin] RBAC: Authorizing `identity:get_project(project_id=db873dfa413a4f2db35e5765d81c96c0)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:01.569810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac8498-93c4-46c2-8050-b919f7542d2b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:01.571518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 584/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:01:01 2022] GET /identity/v3/projects/db873dfa413a4f2db35e5765d81c96c0 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:01.577707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:01.670500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edb11d-1f05-495e-a2d5-778d9a218e1a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:01.702257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:01.702897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:01.703176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:01.703450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:01.704265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=db873dfa413a4f2db35e5765d81c96c0, user.id=adfaf97fd5ce444d99e53df98c8baa41) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:01.704572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:01.705999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde08ba-921e-4b8a-9a8b-b8d3c1e6d918 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:01.711243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 562/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:01:01 2022] GET /identity/v3/role_assignments?user.id=adfaf97fd5ce444d99e53df98c8baa41&scope.project.id=db873dfa413a4f2db35e5765d81c96c0&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:03.986975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ba09-b433-46f2-a236-96bb35f2dd1a None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:03.987550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ba09-b433-46f2-a236-96bb35f2dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:03.987550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8ba09-b433-46f2-a236-96bb35f2dd1a None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:03.988897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 585/1147] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:03.994064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:03.994467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:03.994733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:04.011035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:04.012201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:04.073849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 563/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:04.096739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8ba09-b433-46f2-a236-96bb35f2dd1a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:04.191572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8ba09-b433-46f2-a236-96bb35f2dd1a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:04.223481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423044-221a-49f0-aea4-613ab803384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:04.224260 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423044-221a-49f0-aea4-613ab803384a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:04.224537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423044-221a-49f0-aea4-613ab803384a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:04.224818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423044-221a-49f0-aea4-613ab803384a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:04.235441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98423044-221a-49f0-aea4-613ab803384a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:01:04.242437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-98423044-221a-49f0-aea4-613ab803384a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:01:04.243562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 586/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:04.250990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:04.344251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569722-1755-4097-b62a-c6a20fb10a7a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:04.375634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:04.376289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:04.376571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:04.376846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:04.377584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:04.377889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:04.379281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:04.387648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 564/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:04.393395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423044-221a-49f0-aea4-613ab803384a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:04.486636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423044-221a-49f0-aea4-613ab803384a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:04.518180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:04.518997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:04.519276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:04.519549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] PATH_INFO: `/v3/users/adfaf97fd5ce444d99e53df98c8baa41` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:04.520729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] RBAC: Authorizing `identity:get_user(user_id=adfaf97fd5ce444d99e53df98c8baa41)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:04.522163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:04.523783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 587/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:01:04 2022] GET /identity/v3/users/adfaf97fd5ce444d99e53df98c8baa41 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:04.530071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:04.625125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd58b4-20d3-42cb-b0b8-f07eee36b2bd None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:04.656497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf720-dc83-436d-8c9f-aea13c331b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:04.657341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf720-dc83-436d-8c9f-aea13c331b67 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:04.657620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf720-dc83-436d-8c9f-aea13c331b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:04.657891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf720-dc83-436d-8c9f-aea13c331b67 None admin] PATH_INFO: `/v3/projects/db873dfa413a4f2db35e5765d81c96c0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:04.659088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf720-dc83-436d-8c9f-aea13c331b67 None admin] RBAC: Authorizing `identity:get_project(project_id=db873dfa413a4f2db35e5765d81c96c0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:04.660512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf720-dc83-436d-8c9f-aea13c331b67 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:04.662231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 565/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:01:04 2022] GET /identity/v3/projects/db873dfa413a4f2db35e5765d81c96c0 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:04.668146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:04.761772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219c57-1821-4133-85b7-fdba4d7a05b9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:04.792642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382724bd-65fb-4ce4-8556-9174a6f649fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:04.793516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382724bd-65fb-4ce4-8556-9174a6f649fc None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:04.793800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382724bd-65fb-4ce4-8556-9174a6f649fc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:04.794076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382724bd-65fb-4ce4-8556-9174a6f649fc None admin] PATH_INFO: `/v3/projects/db873dfa413a4f2db35e5765d81c96c0/users/adfaf97fd5ce444d99e53df98c8baa41/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:04.796034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382724bd-65fb-4ce4-8556-9174a6f649fc None admin] RBAC: Authorizing `identity:create_grant(project_id=db873dfa413a4f2db35e5765d81c96c0, user_id=adfaf97fd5ce444d99e53df98c8baa41, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:04.797440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382724bd-65fb-4ce4-8556-9174a6f649fc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:04.867023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 588/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:01:04 2022] PUT /identity/v3/projects/db873dfa413a4f2db35e5765d81c96c0/users/adfaf97fd5ce444d99e53df98c8baa41/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:01:07.118363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d6903-de77-4c8e-8273-af1e3aaaf8a6 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:07.118920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d6903-de77-4c8e-8273-af1e3aaaf8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:07.118920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d6903-de77-4c8e-8273-af1e3aaaf8a6 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:07.120825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 566/1154] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:07.126174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:07.126582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:07.126774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:07.143445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:07.144610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:07.206581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 589/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:07.231811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d6903-de77-4c8e-8273-af1e3aaaf8a6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:07.329066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d6903-de77-4c8e-8273-af1e3aaaf8a6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:07.361037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:07.361808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:07.362088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:07.362392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:07.371995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:01:07.378832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:01:07.380208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 567/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:07.386672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:07.479059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd29d8-daa4-4879-a6a5-56fd32643641 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:07.509981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:07.511293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:07.511576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:07.511852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:07.512597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:07.512902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:07.514279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:07.521848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 590/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:07.527695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:07.622222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6084-b8ea-4c4c-9db4-e90ded4e0572 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:07.653898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:07.654772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:07.655060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:07.655332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] PATH_INFO: `/v3/users/adfaf97fd5ce444d99e53df98c8baa41` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:07.656499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=adfaf97fd5ce444d99e53df98c8baa41)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:07.657916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:07.659548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 568/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:01:07 2022] GET /identity/v3/users/adfaf97fd5ce444d99e53df98c8baa41 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:07.665181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:07.759182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227f30a-b7bd-4f34-b27b-3f74fbe0026c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:07.790100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:07.790759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:07.791041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:07.791418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:07.854051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:07.855466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:07.948527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 591/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:01:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:01:07.954267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:08.047055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd31b8-1b62-410b-9ea8-cb9915d7e6f7 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:08.077875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bedd4f-0157-4a9f-a068-1d5492c156e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:08.078744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bedd4f-0157-4a9f-a068-1d5492c156e5 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:08.079025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bedd4f-0157-4a9f-a068-1d5492c156e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:08.079301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bedd4f-0157-4a9f-a068-1d5492c156e5 None admin] PATH_INFO: `/v3/projects/db873dfa413a4f2db35e5765d81c96c0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:08.080458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bedd4f-0157-4a9f-a068-1d5492c156e5 None admin] RBAC: Authorizing `identity:get_project(project_id=db873dfa413a4f2db35e5765d81c96c0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:08.081879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bedd4f-0157-4a9f-a068-1d5492c156e5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:08.083590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 569/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:01:07 2022] GET /identity/v3/projects/db873dfa413a4f2db35e5765d81c96c0 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:08.090182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:08.180770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6808d-6615-4420-8cde-82df1d864a7e None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:08.212675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:08.213344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:08.213628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:08.213903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:08.214755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=db873dfa413a4f2db35e5765d81c96c0, user.id=adfaf97fd5ce444d99e53df98c8baa41) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:08.215064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:08.216491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7436d-7756-451f-8eb2-77cb87e3b68f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:08.221986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 592/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:01:08 2022] GET /identity/v3/role_assignments?user.id=adfaf97fd5ce444d99e53df98c8baa41&scope.project.id=db873dfa413a4f2db35e5765d81c96c0&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:10.534362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0715-4ff3-4301-a8b3-836b33f22f51 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:10.534898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0715-4ff3-4301-a8b3-836b33f22f51 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:10.534898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0715-4ff3-4301-a8b3-836b33f22f51 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:10.536282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 570/1162] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:10.542006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:10.542561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:10.542854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:10.559649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:10.560822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:10.623523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 593/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:10.645280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0715-4ff3-4301-a8b3-836b33f22f51 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:10.742159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0715-4ff3-4301-a8b3-836b33f22f51 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:10.773454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:10.774085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:10.774464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:10.774741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:10.836835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:10.838812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:10.929708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 571/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:01:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:01:10.937146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:11.029620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90249f-f473-4f16-8e75-d64156a1033a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:11.060969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:11.061763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:11.062045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:11.062374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:11.068802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:11.070261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:11.083907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-0351b380-79cf-422b-8200-d7f7043b7b76 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 11 13:01:11.085073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 594/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:01:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:11.091677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:11.184534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269eea-1c82-4348-aec6-87e3eba4fd7c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:11.216853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:11.217498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:11.217777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:11.218048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:11.218795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:11.219098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:11.220453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fa6ad-00eb-446d-bf22-2299b7d846cf None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:11.227644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 572/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Apr 11 13:01:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:13.480379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c330-dec4-4b14-b271-1b9b26315239 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:13.480917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c330-dec4-4b14-b271-1b9b26315239 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:13.480917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6c330-dec4-4b14-b271-1b9b26315239 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:13.482335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 595/1167] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:13.487423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310fb33-a63f-4d57-a323-b1e8228c4da2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:13.487841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310fb33-a63f-4d57-a323-b1e8228c4da2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:13.487980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310fb33-a63f-4d57-a323-b1e8228c4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:13.504746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9310fb33-a63f-4d57-a323-b1e8228c4da2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:13.505926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9310fb33-a63f-4d57-a323-b1e8228c4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:13.568611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 573/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:13.592339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6c330-dec4-4b14-b271-1b9b26315239 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:13.687501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6c330-dec4-4b14-b271-1b9b26315239 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:13.718442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec1e65-ac51-4b9c-bb11-86c5dc80b818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:13.719078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec1e65-ac51-4b9c-bb11-86c5dc80b818 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:13.719353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec1e65-ac51-4b9c-bb11-86c5dc80b818 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:13.719625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec1e65-ac51-4b9c-bb11-86c5dc80b818 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:13.720341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec1e65-ac51-4b9c-bb11-86c5dc80b818 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:13.721684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec1e65-ac51-4b9c-bb11-86c5dc80b818 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:13.787511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 596/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Mon Apr 11 13:01:13 2022] POST /identity/v3/domains => generated 267 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:01:16.152963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17b53-beee-443f-9561-ba66fc80508b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:16.153488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17b53-beee-443f-9561-ba66fc80508b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:16.153488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17b53-beee-443f-9561-ba66fc80508b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:16.155355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 574/1170] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:01:16.160343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:16.160762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:16.160903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:16.177636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:16.178842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:16.241306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 597/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:01:16.266553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb17b53-beee-443f-9561-ba66fc80508b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:16.366035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb17b53-beee-443f-9561-ba66fc80508b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:16.397878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dbd35-80c8-4206-a62f-abc574a4299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:16.398773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbd35-80c8-4206-a62f-abc574a4299f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:16.399050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbd35-80c8-4206-a62f-abc574a4299f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:16.399321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbd35-80c8-4206-a62f-abc574a4299f None admin] PATH_INFO: `/v3/domains/19a16e6ffe834c14837bb6b304fcc067` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:16.410095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dbd35-80c8-4206-a62f-abc574a4299f None admin] RBAC: Authorizing `identity:get_domain(domain_id=19a16e6ffe834c14837bb6b304fcc067)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:16.411624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dbd35-80c8-4206-a62f-abc574a4299f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:16.413260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 575/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Apr 11 13:01:16 2022] GET /identity/v3/domains/19a16e6ffe834c14837bb6b304fcc067 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:16.419096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:16.510891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206720d8-105d-4032-a029-a1c48de01e09 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:16.542761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9d8b8-0dac-4e81-a28f-0ef1f0d9e16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:16.543514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d8b8-0dac-4e81-a28f-0ef1f0d9e16d None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:16.543888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d8b8-0dac-4e81-a28f-0ef1f0d9e16d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:16.544259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9d8b8-0dac-4e81-a28f-0ef1f0d9e16d None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:16.545043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d8b8-0dac-4e81-a28f-0ef1f0d9e16d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:16.546583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9d8b8-0dac-4e81-a28f-0ef1f0d9e16d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:16.662336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 598/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:01:16 2022] POST /identity/v3/projects => generated 361 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:01:18.971724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba543bf-198c-4eac-a68e-fc4b3a78bb6c None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:18.972266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba543bf-198c-4eac-a68e-fc4b3a78bb6c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:18.972266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba543bf-198c-4eac-a68e-fc4b3a78bb6c None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:18.973637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 576/1174] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:18.979103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:18.979496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:18.979646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:18.996189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:18.997344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:19.059506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 599/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:19.085478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba543bf-198c-4eac-a68e-fc4b3a78bb6c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:19.181215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba543bf-198c-4eac-a68e-fc4b3a78bb6c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:19.213312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a7e37-e776-4c0e-b552-0ffa62fec6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:19.214181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7e37-e776-4c0e-b552-0ffa62fec6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:19.214465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7e37-e776-4c0e-b552-0ffa62fec6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:19.214738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7e37-e776-4c0e-b552-0ffa62fec6c3 None admin] PATH_INFO: `/v3/domains/19a16e6ffe834c14837bb6b304fcc067` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:19.215901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a7e37-e776-4c0e-b552-0ffa62fec6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=19a16e6ffe834c14837bb6b304fcc067)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:19.217354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a7e37-e776-4c0e-b552-0ffa62fec6c3 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:19.218990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 577/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Apr 11 13:01:19 2022] GET /identity/v3/domains/19a16e6ffe834c14837bb6b304fcc067 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:19.224612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:19.317369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09ef8-e050-462c-a133-2c0029d82603 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:19.349005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051ff4-95e7-4a2c-bcbc-ac25e3a57bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:19.349661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051ff4-95e7-4a2c-bcbc-ac25e3a57bfa None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:19.349938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051ff4-95e7-4a2c-bcbc-ac25e3a57bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:19.350260 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051ff4-95e7-4a2c-bcbc-ac25e3a57bfa None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:19.350993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051ff4-95e7-4a2c-bcbc-ac25e3a57bfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:19.352739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051ff4-95e7-4a2c-bcbc-ac25e3a57bfa None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:19.455072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 600/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 13:01:19 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:01:21.771729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f90171-d525-4268-8274-4da18693289a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:21.772233 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f90171-d525-4268-8274-4da18693289a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:21.772324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f90171-d525-4268-8274-4da18693289a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:21.773665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 578/1178] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:21.779126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:21.779555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:21.779690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:21.796380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:21.797553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:21.860445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 601/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:21.885773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f90171-d525-4268-8274-4da18693289a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:21.980005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f90171-d525-4268-8274-4da18693289a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:22.012482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:22.013258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:22.013539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:22.013812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:22.023528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:01:22.030900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:01:22.032076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 579/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:22.037875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:22.129259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fe66-b1e9-4c1d-9426-9b1caa8043a9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:22.161232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:22.161880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:22.162208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:22.162480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:22.163215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:22.163514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:22.164853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:22.172980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 602/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:01:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:01:22.178683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:22.272312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76f37-9f20-4b9e-a0bc-6f122ab48007 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:22.303735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:22.304527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:22.304802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:22.305073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] PATH_INFO: `/v3/users/8e941805de664690862a7626a37abe08` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:22.317445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] RBAC: Authorizing `identity:get_user(user_id=8e941805de664690862a7626a37abe08)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:22.318894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:22.320560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 580/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:01:22 2022] GET /identity/v3/users/8e941805de664690862a7626a37abe08 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:22.327114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:22.420986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbc717-95bd-4da6-ae40-032b8b1cbf2b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:22.452366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:22.453005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:22.453282 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:22.453549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:22.516291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:22.517703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:22.607820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 603/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:01:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:01:22.613771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:22.706778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a382be1-2a83-432a-adf5-1965e1f36402 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:22.737783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909c3dd-3580-4ef1-b337-0dc55f72512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:22.738646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c3dd-3580-4ef1-b337-0dc55f72512c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:22.738924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c3dd-3580-4ef1-b337-0dc55f72512c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:22.739199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c3dd-3580-4ef1-b337-0dc55f72512c None admin] PATH_INFO: `/v3/projects/a27e2059eca942d7bcdacee9d5aec176` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:22.740348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909c3dd-3580-4ef1-b337-0dc55f72512c None admin] RBAC: Authorizing `identity:get_project(project_id=a27e2059eca942d7bcdacee9d5aec176)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:22.741759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909c3dd-3580-4ef1-b337-0dc55f72512c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:22.743470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 581/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:01:22 2022] GET /identity/v3/projects/a27e2059eca942d7bcdacee9d5aec176 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:22.750192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:22.840933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a2a78-7aae-4071-8a2e-4cca1b8916e4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:22.872856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:22.873455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:22.873720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:22.873994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:22.874844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=a27e2059eca942d7bcdacee9d5aec176, user.id=8e941805de664690862a7626a37abe08) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:22.875153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:22.876555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb26bb-4413-41ae-a40e-6a0e7de8ea33 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:22.881766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 604/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:01:22 2022] GET /identity/v3/role_assignments?user.id=8e941805de664690862a7626a37abe08&scope.project.id=a27e2059eca942d7bcdacee9d5aec176&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:25.129213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902330b-8818-490d-8240-1b98f4488df8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.129749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902330b-8818-490d-8240-1b98f4488df8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.129749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902330b-8818-490d-8240-1b98f4488df8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.131213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 582/1186] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:25.137040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.137421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.137596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.153782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:25.154991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:25.216796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 605/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:25.239690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902330b-8818-490d-8240-1b98f4488df8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:25.336792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902330b-8818-490d-8240-1b98f4488df8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:25.368842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:25.369739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.370136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.370420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.380454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:01:25.388192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:01:25.389423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 583/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:25.396765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:25.492338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08928115-23a4-4dfe-a27c-efb976ae2546 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:25.523845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:25.524500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.524782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.525055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.525837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:25.526167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:25.527510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:25.535075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 606/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:25.540806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:25.634183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660800c-63f5-4209-8ffb-7ccf76dafd8c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:25.665119 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:25.665964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.666901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.667142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] PATH_INFO: `/v3/users/8e941805de664690862a7626a37abe08` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.668297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] RBAC: Authorizing `identity:get_user(user_id=8e941805de664690862a7626a37abe08)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:25.669703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:25.671331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 584/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:01:25 2022] GET /identity/v3/users/8e941805de664690862a7626a37abe08 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:25.676907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:25.768821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44ab2-b67e-48e3-8e64-e8dc2d935ce4 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:25.800664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3daa0b-e171-4edb-a1f9-b2a198e54573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:25.801499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3daa0b-e171-4edb-a1f9-b2a198e54573 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.801775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3daa0b-e171-4edb-a1f9-b2a198e54573 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.802042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3daa0b-e171-4edb-a1f9-b2a198e54573 None admin] PATH_INFO: `/v3/projects/a27e2059eca942d7bcdacee9d5aec176` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.803470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3daa0b-e171-4edb-a1f9-b2a198e54573 None admin] RBAC: Authorizing `identity:get_project(project_id=a27e2059eca942d7bcdacee9d5aec176)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:25.804876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3daa0b-e171-4edb-a1f9-b2a198e54573 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:25.806606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 607/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:01:25 2022] GET /identity/v3/projects/a27e2059eca942d7bcdacee9d5aec176 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:25.812637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:25.906683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024acb1-eb55-4ae4-917c-8cf75f218883 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:25.937792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77807d89-8ccb-45c8-9549-ef124ae3a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:25.938690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77807d89-8ccb-45c8-9549-ef124ae3a666 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:25.938968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77807d89-8ccb-45c8-9549-ef124ae3a666 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:25.939240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77807d89-8ccb-45c8-9549-ef124ae3a666 None admin] PATH_INFO: `/v3/projects/a27e2059eca942d7bcdacee9d5aec176/users/8e941805de664690862a7626a37abe08/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:25.941151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77807d89-8ccb-45c8-9549-ef124ae3a666 None admin] RBAC: Authorizing `identity:create_grant(project_id=a27e2059eca942d7bcdacee9d5aec176, user_id=8e941805de664690862a7626a37abe08, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:25.942603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77807d89-8ccb-45c8-9549-ef124ae3a666 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:25.998426 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 585/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:01:25 2022] PUT /identity/v3/projects/a27e2059eca942d7bcdacee9d5aec176/users/8e941805de664690862a7626a37abe08/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:01:28.241032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432d6b-e072-427e-953a-046399cc25dd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:28.241585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432d6b-e072-427e-953a-046399cc25dd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:28.241585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432d6b-e072-427e-953a-046399cc25dd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:28.242986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 608/1193] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:01:28.248044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:28.248426 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:28.248594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:28.265207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:01:28.266401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:01:28.328880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 586/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:01:28.354401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432d6b-e072-427e-953a-046399cc25dd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:28.450507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432d6b-e072-427e-953a-046399cc25dd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:28.482579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:28.483354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:28.483633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:28.483906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:28.493420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:01:28.500352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:01:28.501529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 609/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:01:28.507656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:28.599467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4710-5e19-4091-8b39-85d45e9d2666 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:28.631082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:28.631733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:28.632017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:28.632288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:28.633027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:28.633330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:28.634720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:28.643122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 587/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:28.648738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:28.740933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb6769-5582-4458-b72b-41c89809f156 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:28.772705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350db386-5b9a-407d-9807-75583929eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:28.773557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350db386-5b9a-407d-9807-75583929eefc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:28.773840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350db386-5b9a-407d-9807-75583929eefc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:28.774139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350db386-5b9a-407d-9807-75583929eefc None admin] PATH_INFO: `/v3/users/8e941805de664690862a7626a37abe08` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:28.775308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350db386-5b9a-407d-9807-75583929eefc None admin] RBAC: Authorizing `identity:get_user(user_id=8e941805de664690862a7626a37abe08)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:28.776742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350db386-5b9a-407d-9807-75583929eefc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:28.778378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 610/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Apr 11 13:01:28 2022] GET /identity/v3/users/8e941805de664690862a7626a37abe08 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:01:28.784194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:28.877442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ab09-c3c4-4a0a-baf9-2187fafc0f4d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:28.909170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:28.909804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:28.910143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:28.910415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:28.972624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:28.974051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:29.064638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 588/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:01:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:01:29.070486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350db386-5b9a-407d-9807-75583929eefc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:29.163811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350db386-5b9a-407d-9807-75583929eefc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:29.194379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bb22d-3a72-4165-9961-d785d5acf3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:29.195222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb22d-3a72-4165-9961-d785d5acf3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:29.195500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb22d-3a72-4165-9961-d785d5acf3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:29.195772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb22d-3a72-4165-9961-d785d5acf3f6 None admin] PATH_INFO: `/v3/projects/a27e2059eca942d7bcdacee9d5aec176` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:29.196921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bb22d-3a72-4165-9961-d785d5acf3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=a27e2059eca942d7bcdacee9d5aec176)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:29.198974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bb22d-3a72-4165-9961-d785d5acf3f6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:29.200641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 611/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Apr 11 13:01:29 2022] GET /identity/v3/projects/a27e2059eca942d7bcdacee9d5aec176 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:01:29.206700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:01:29.298437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e318b2-dba9-4a5c-b325-f5ffce9b407e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:01:29.329988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:01:29.330597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:01:29.330950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:01:29.331219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:01:29.332031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=a27e2059eca942d7bcdacee9d5aec176, user.id=8e941805de664690862a7626a37abe08) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:01:29.332336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:01:29.333731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6aa73-8092-4eb6-aaae-bc7bb2e7616a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:01:29.339813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 589/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:01:29 2022] GET /identity/v3/role_assignments?user.id=8e941805de664690862a7626a37abe08&scope.project.id=a27e2059eca942d7bcdacee9d5aec176&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:48.187582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462de8-27ce-4544-975a-cb16e50239dd None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:48.188158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462de8-27ce-4544-975a-cb16e50239dd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:48.188158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462de8-27ce-4544-975a-cb16e50239dd None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:48.189483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 612/1201] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:02:48.194798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:48.195232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:48.195330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:48.212921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:02:48.217732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:02:48.280179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 590/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:02:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:02:48.307086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462de8-27ce-4544-975a-cb16e50239dd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:48.405202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462de8-27ce-4544-975a-cb16e50239dd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:48.441047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:48.441047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:48.441047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:48.441047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:48.449461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:48.450949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:48.467539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:02:48.468915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 613/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:48.474884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:48.569704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594571ff-c04b-48c1-8c45-2f45d9eda27c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:48.602242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:48.603542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:48.604082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:48.604351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:48.605062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:48.605360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:48.606812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688741d-b217-441c-9d67-5bb7147c7be9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:48.617507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 591/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:02:48.623903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:48.717902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f0003-a834-43a5-a9da-d28d47139fc9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:48.751530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1019ad-c01c-438a-8d90-f52ca7450d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:48.752201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1019ad-c01c-438a-8d90-f52ca7450d46 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:48.752485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1019ad-c01c-438a-8d90-f52ca7450d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:48.752758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1019ad-c01c-438a-8d90-f52ca7450d46 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:48.753452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1019ad-c01c-438a-8d90-f52ca7450d46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:48.754911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1019ad-c01c-438a-8d90-f52ca7450d46 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:48.899100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 614/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Apr 11 13:02:48 2022] POST /identity/v3/users => generated 251 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:02:51.246512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4a8cd-aa20-4112-b74e-867db103cdf2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:51.247064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4a8cd-aa20-4112-b74e-867db103cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:51.247175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4a8cd-aa20-4112-b74e-867db103cdf2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:51.248483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 592/1206] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:02:51.253599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:51.253983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:51.254198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:51.271862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:02:51.273141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:02:51.337810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 615/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:02:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:02:51.362725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4a8cd-aa20-4112-b74e-867db103cdf2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:51.462251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4a8cd-aa20-4112-b74e-867db103cdf2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:51.495522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:51.496314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:51.496641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:51.496870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:51.506818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:02:51.514634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:02:51.515830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 593/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 13:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:51.521920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:51.618860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff2aa4-947a-467d-b511-c9a219a8818a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:51.650575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:51.651229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:51.651512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:51.651788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:51.652529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:51.652835 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:51.654210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:51.661736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 616/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 13:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:51.668040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:51.764967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5761a9-a95d-463a-9150-6975cc29c182 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:51.797785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:51.798632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:51.798910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:51.799179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:51.809798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:51.815779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:51.827074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:02:51.828261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 594/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:51.834021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:51.927969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168ee98-1fb0-45f9-bc62-dcc5f138f5f1 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:51.959233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:51.959890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:51.960172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:51.960446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:51.961163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:51.961467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:51.963387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:51.974592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 617/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:02:51.981268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:52.074804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc556-7948-4420-8de6-354b089b0cf6 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:52.108000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:52.108794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:52.109075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:52.109348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:52.116728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:52.122511 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:52.131767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:02:52.132949 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 595/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:52.139266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:52.235939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807ddb-a886-4e5e-80e5-79bbb2dc5e4c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:52.267693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:52.268356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:52.268637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:52.268912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:52.269744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:52.270052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:52.271486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:52.289554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 618/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Apr 11 13:02:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:52.295679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:52.391400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c59e7-684f-418d-89ae-bf302bbe3682 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:52.424043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:52.424690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:52.424970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:52.425245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:52.488804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:52.490261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:52.581497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 596/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:02:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:02:52.588169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:52.680386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301736-e8cc-4bd3-a25d-a02be2144012 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:52.712767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:52.713709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:52.713984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:52.714286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:52.724073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:52.725534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:52.742758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:02:52.744163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 619/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:52.749976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:52.843862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a3d3c-8c57-4adc-a3f8-e7cf97f632f8 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:52.876552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:52.877203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:52.877484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:52.877759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:52.878504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:52.878811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:52.880180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:52.891003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 597/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:52.896735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:52.993483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5d38-29a1-49b4-afbf-55abc0264979 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:53.026251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:53.027036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:53.027309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:53.027580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:53.033956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:53.035397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:53.048179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:02:53.049334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 620/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:53.055294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:53.151182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6732-d0d9-4078-87f6-6e825ca2ab78 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:53.183008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:53.183717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:53.183993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:53.184264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:53.185041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:53.185378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:53.186866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211d6a6-8ee1-40aa-a4d4-7d103e014710 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:53.199144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 598/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:53.205258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:53.301264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ed794-0889-4397-91ee-57a2d6440343 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:53.334286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:53.334943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:53.335227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:53.335503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:53.336336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=e5fb9818914042078c9fe53bfa51e6f4) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:53.336645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:53.338886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214881ae-7cd5-481d-a879-58a2b6d701c9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:53.344181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 621/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:02:53 2022] GET /identity/v3/role_assignments?user.id=e5fb9818914042078c9fe53bfa51e6f4&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:55.621239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efcea-db0c-4461-aab3-1b0414290d7e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:55.621811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efcea-db0c-4461-aab3-1b0414290d7e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:55.621811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efcea-db0c-4461-aab3-1b0414290d7e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:55.623227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 599/1220] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:02:55.628658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:55.629086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:55.629226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:55.646587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:02:55.647704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:02:55.712974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 622/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:02:55.735708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429efcea-db0c-4461-aab3-1b0414290d7e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:55.832755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429efcea-db0c-4461-aab3-1b0414290d7e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:55.864711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:55.865487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:55.865765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:55.866032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:55.876364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:02:55.883329 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:02:55.885294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 600/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 13:02:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:55.892602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:55.990599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1b0dd-bcd0-489f-9cb8-65ead0c322f4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.023138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.023805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.024086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.024916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.025751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] RBAC: Adding query filter params (name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:56.026047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.027414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.035033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 623/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 13:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:56.040712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:56.137420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b6b30-a62f-4928-a1e9-b36aae2d0b10 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.172676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.173938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.174348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.174667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.185473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.186966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.204104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:02:56.205287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 601/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:56.211190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:56.306563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fc8a0-1d61-41a7-8db9-da52ec0c131f None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.340596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.341257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.341541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.341818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.342570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:56.342876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.344230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.355846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 624/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:56.361504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:56.458732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f36d7-88de-474f-9462-0933fb55d91b None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.491630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.492416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.492691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.492968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.499661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.501077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.515553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:02:56.520603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 602/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:56.522578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:56.618569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c525f2-29e9-484e-98d9-776c9d8b3ba9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.650524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.651190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.651470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.651748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.652584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:56.652894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.654357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.670837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 625/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:56.676531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:56.773468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a345ab-44cd-445b-b616-ee1471dc579f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.807533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.808300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.808578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.808849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.818577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.820041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.836536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:02:56.837821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 603/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:56.843614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:56.941454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bb883-13d7-49d7-afc3-a27d8593d0f8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:56.974621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:56.975270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:56.975553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:56.975827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:56.976553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:56.976857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:56.978419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:56.989499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 626/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:56.995200 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:57.090051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928329d7-ffde-4913-86b5-a05cebf4121a None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:57.121738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:57.122540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:57.122817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:57.123088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:57.129404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:57.130852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:57.143912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:02:57.145071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 604/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:02:57.151136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:57.246166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7123-1a5d-4658-9940-5c5b2cbfddfc None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:57.277469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:57.278139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:57.278427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:57.278703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:57.279490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:02:57.279794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:57.281205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d217d11-a0f8-41e5-a09b-7ad5e6cfcad8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:57.292615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 627/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:02:57.298676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:02:57.396545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a369a8-993d-4a26-bd71-3f29f93dd79e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:02:57.429342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9bd96-47c8-458c-96a4-7fe81ad61bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:02:57.430813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bd96-47c8-458c-96a4-7fe81ad61bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:57.431280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bd96-47c8-458c-96a4-7fe81ad61bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:57.431497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bd96-47c8-458c-96a4-7fe81ad61bd5 None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/e5fb9818914042078c9fe53bfa51e6f4/roles/479e0ab1a5c949eda00bbd1254fa8d69` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:57.445096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9bd96-47c8-458c-96a4-7fe81ad61bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=e5fb9818914042078c9fe53bfa51e6f4, role_id=479e0ab1a5c949eda00bbd1254fa8d69)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:02:57.447138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9bd96-47c8-458c-96a4-7fe81ad61bd5 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:02:57.535207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 605/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:02:57 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/e5fb9818914042078c9fe53bfa51e6f4/roles/479e0ab1a5c949eda00bbd1254fa8d69 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:02:59.808068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ca09-40ea-4611-88c8-ab809c55411e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:59.808624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ca09-40ea-4611-88c8-ab809c55411e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:59.808624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ca09-40ea-4611-88c8-ab809c55411e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:59.810021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 628/1233] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:02:59.815108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:02:59.815500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:02:59.815655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:02:59.833052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:02:59.834282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:02:59.901215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 606/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:02:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:02:59.926561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1ca09-40ea-4611-88c8-ab809c55411e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.033848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1ca09-40ea-4611-88c8-ab809c55411e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:00.070064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:00.070799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:00.071131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:00.071600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:00.081684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:03:00.090305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:03:00.090305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 629/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Apr 11 13:02:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:00.096189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.200476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49db506-4fd2-4cf8-ba94-f47ea112abfd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:00.235571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:00.236236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:00.236514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:00.236786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:00.237522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] RBAC: Adding query filter params (name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:00.237826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:00.239267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:00.246935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 607/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Apr 11 13:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:00.252734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.347736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7887395-8e25-43d8-875e-ebaddf7b571c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:00.379739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:00.380559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:00.380837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:00.381137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:00.391627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:00.393066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:00.409855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:00.411100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 630/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:00.417509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.514198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7c86-ad82-4d04-bd3e-269e46823856 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:00.546240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:00.546896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:00.547174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:00.547444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:00.548157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:00.548457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:00.549811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:00.561689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 608/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:00.567487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.665373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2558-0ad0-49d7-966b-a38ae75056bf None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:00.697849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:00.698672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:00.698957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:00.699234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:00.706569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:00.708014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:00.722239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:03:00.723458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 631/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:00.730077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.826066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84a34c-fc96-48e0-ac5b-314dd0c118b1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:00.859540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:00.860217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:00.860502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:00.860782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:00.861657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:00.862014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:00.863471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:00.880447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 609/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Apr 11 13:03:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:00.886841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:00.983702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68335-0709-414a-b591-f4883e512c81 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:01.017452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:01.018134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:01.018418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:01.018691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:01.082710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:01.084158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:01.177261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 632/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:03:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:03:01.183894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:01.279190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c3d5e-159a-4bb6-ae2f-fb84be9e585c None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:01.312925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:01.313698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:01.313973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:01.314271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:01.324075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:01.325565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:01.342142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:01.343309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 610/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:01.349129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:01.447657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5c42-6eda-4969-8bcd-26fedfbf965a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:01.479251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:01.479897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:01.480172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:01.480440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:01.481148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:01.481446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:01.482822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:01.494145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 633/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:01.499801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:01.594187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778920-db5b-49fd-8f50-ca1ed6ef1332 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:01.627571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:01.628349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:01.628628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:01.628900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:01.635602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:01.637102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:01.650281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:03:01.651754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 611/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:01.657823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:01.754040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197e8e-5664-4f6a-a7ff-b2ce49a0df79 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:01.786159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:01.786815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:01.787097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:01.787373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:01.788155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:01.788461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:01.790565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f6139-3abd-411d-8a04-7d73350ab884 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:01.802676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 634/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:03:01.808912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:01.905122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428effcc-748a-471e-b05f-e04fd9ee1011 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:01.936400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:01.939345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:01.939345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:01.939345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:01.939345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] RBAC: Adding query filter params (role.id=479e0ab1a5c949eda00bbd1254fa8d69, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=e5fb9818914042078c9fe53bfa51e6f4) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:01.939345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:01.940076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd064266-6fc6-43f7-a46c-d4dbe0520bbb None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:01.945599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 612/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:03:01 2022] GET /identity/v3/role_assignments?user.id=e5fb9818914042078c9fe53bfa51e6f4&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=479e0ab1a5c949eda00bbd1254fa8d69 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:04.262179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b4dad-279b-4668-81e3-7e2351c54f84 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:04.262785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b4dad-279b-4668-81e3-7e2351c54f84 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:04.262785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b4dad-279b-4668-81e3-7e2351c54f84 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:04.264176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 635/1247] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:04.269153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:04.269515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:04.269706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:04.286500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:04.287645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:04.351245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 613/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:04.375474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b4dad-279b-4668-81e3-7e2351c54f84 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:04.474923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b4dad-279b-4668-81e3-7e2351c54f84 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:04.507058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:04.507845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:04.508125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:04.508936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:04.518580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:03:04.526247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:03:04.527429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 636/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:04.533504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:04.625523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8582f-703f-464f-9637-6fc305c0b464 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:04.659193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:04.659849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:04.660126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:04.660395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:04.661134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:04.661437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:04.662944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:04.670697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 614/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:04.676464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:04.773035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58839bf3-f4d4-48cc-8a3a-1df1a8522dc8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:04.804350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:04.805635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:04.806028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:04.806377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:04.816960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:04.818505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:04.836009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:04.837231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 637/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:04.843130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:04.942032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde714-065f-486e-81ba-81ec2f960f75 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:04.975366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:04.976020 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:04.976302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:04.976577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:04.977819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:04.978151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:04.979783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:04.991612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 615/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:04.998278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:05.093760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096341-117e-4dfc-9c75-e2cdfc90a48a None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:05.126090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:05.126925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:05.127207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:05.127492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:05.136044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:05.140422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:05.150666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:03:05.151831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 638/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:05.157840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:05.252297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a25c3-9018-47d6-9e82-057d80618b23 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:05.283785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:05.284446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:05.284728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:05.284999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:05.285862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:05.286212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:05.287632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:05.304733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 616/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Apr 11 13:03:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:05.311499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:05.408025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a28880-b1f8-4601-8c49-5eebb4a19e8b None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:05.440235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:05.440966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:05.441246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:05.441517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:05.505905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:05.507461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:05.600844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 639/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:03:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:03:05.607754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:05.701219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53376ba5-2a5f-4d12-807c-371c6dd01776 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:05.734275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:05.735051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:05.735328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:05.735599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:05.744997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:05.746457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:05.763167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:05.764335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 617/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:05.770318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:05.862409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9168f-2d3f-4445-88f0-21f612f8937d None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:05.894704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:05.895359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:05.895641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:05.895917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:05.896641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:05.896946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:05.898331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:05.909556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 640/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:05.915999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:06.012362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82165d40-fb27-4650-8814-8b488d081c24 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:06.045135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:06.045919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:06.046225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:06.046501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] PATH_INFO: `/v3/projects/service` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:06.052808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:06.054265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:06.066958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:03:06.068118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 618/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:03:06.074890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:06.168317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f883a4b-0f2c-4b56-b139-f82d678df6a6 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:06.201404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:06.202067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:06.202380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:06.202658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:06.203474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:06.203780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:06.205201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fd6db-4a22-4dc5-b8e4-9e7e5efcd740 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:06.217051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 641/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:03:06.223125 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:06.319823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3219e0-4a6a-4bc3-95c9-db1d0aa1bead None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:06.353330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:06.354261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:06.354542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:06.354815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:06.355638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=e5fb9818914042078c9fe53bfa51e6f4) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:06.355947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:06.357420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee3ca0-dc95-4eb3-8058-52490d00bc7c None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:06.362662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 619/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:03:06 2022] GET /identity/v3/role_assignments?user.id=e5fb9818914042078c9fe53bfa51e6f4&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:03:08.642678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a513-fb53-4630-b53a-21c8eeedb55d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:08.643201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a513-fb53-4630-b53a-21c8eeedb55d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:08.643201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a513-fb53-4630-b53a-21c8eeedb55d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:08.644510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 642/1261] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:08.650330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:08.650824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:08.650974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:08.667940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:08.669101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:08.733450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 620/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:08.755321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598a513-fb53-4630-b53a-21c8eeedb55d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:08.852233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598a513-fb53-4630-b53a-21c8eeedb55d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:08.885740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:08.886554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:08.886836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:08.887108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:08.901912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:03:08.904512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:03:08.905725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 643/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:08.913331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.010174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fcc4c-0abb-4c5e-8b75-77bfa958d17c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.042944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.048808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.048808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.048808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.048808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:09.048808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.048808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.054459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 621/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:09.061076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.157066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81947319-1998-4430-b586-5889b8b9ea65 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.188579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.189358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.189635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.189905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.199838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.201254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.217599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:09.218799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 644/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:09.224551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.319415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6d29d-c8af-4e7e-a57e-9053bcee0e3e None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.351312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.352527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.352819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.353186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.354181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:09.354490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.355848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.367128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 622/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:09.373289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.469974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ced26-52b2-43b0-a7da-9afe3c2137f9 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.501553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.502379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.502660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.502933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.510535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.512745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.525876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:03:09.527087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 645/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:09.532903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.628702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203c985-1728-4c0c-842c-cbb1a54bb824 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.661454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.662153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.662462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.662737 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.663566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:09.663871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.665494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.682068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 623/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Apr 11 13:03:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:03:09.690479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.784534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b525e-37b2-41a3-b4da-d6b4577447b8 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.816363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.817149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.817431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.817703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.828423 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.829833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.846085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:09.851610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 646/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:09.853138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:09.948416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93064506-e50a-40cd-b00c-6397dddef82f None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:09.982398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:09.983061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:09.983341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:09.983615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:09.984417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:09.984724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:09.986097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:09.997547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 624/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:10.003183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:10.099199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277c5c6-dc8c-4e3d-ab7b-30e0a63d5a54 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:10.132351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:10.133810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:10.134406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:10.134707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:10.141351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:10.142862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:10.156762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:03:10.157922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 647/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:10.163788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:10.259014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e673e-4b0c-4f9b-b113-a043bee96f61 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:10.291179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:10.291849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:10.292128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:10.292401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:10.293184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:10.293488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:10.296690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520148a4-11df-4fef-b97e-4a92cadb824f None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:10.308894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 625/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:10.315073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:10.409124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d12ca-481b-4f17-8f44-48181c50204c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:10.443131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb140d5-9054-4848-82bd-d8e1121a048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:10.444781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb140d5-9054-4848-82bd-d8e1121a048b None admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:10.444781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb140d5-9054-4848-82bd-d8e1121a048b None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:10.444781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb140d5-9054-4848-82bd-d8e1121a048b None admin] PATH_INFO: `/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/e5fb9818914042078c9fe53bfa51e6f4/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:10.446668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb140d5-9054-4848-82bd-d8e1121a048b None admin] RBAC: Authorizing `identity:create_grant(project_id=639c0c8a7c9e4390a007d1a82a290ab7, user_id=e5fb9818914042078c9fe53bfa51e6f4, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:10.448080 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb140d5-9054-4848-82bd-d8e1121a048b None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:10.526665 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 648/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Apr 11 13:03:10 2022] PUT /identity/v3/projects/639c0c8a7c9e4390a007d1a82a290ab7/users/e5fb9818914042078c9fe53bfa51e6f4/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:03:12.803220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230167-934d-4906-85f2-05d0c4ecd937 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:12.803757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230167-934d-4906-85f2-05d0c4ecd937 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:12.803757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230167-934d-4906-85f2-05d0c4ecd937 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:12.806156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 626/1274] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:12.811378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278284-4477-486c-9882-6dee886eae62 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:12.811778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278284-4477-486c-9882-6dee886eae62 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:12.823114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278284-4477-486c-9882-6dee886eae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:12.828816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-92278284-4477-486c-9882-6dee886eae62 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:12.830000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-92278284-4477-486c-9882-6dee886eae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:12.895107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 649/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:12.921382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230167-934d-4906-85f2-05d0c4ecd937 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.016991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230167-934d-4906-85f2-05d0c4ecd937 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:13.049777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:13.050589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:13.050872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:13.051142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:13.060872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:03:13.067738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:03:13.068920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 627/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Apr 11 13:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:13.075171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278284-4477-486c-9882-6dee886eae62 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.169601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278284-4477-486c-9882-6dee886eae62 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:13.201913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:13.202607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:13.202886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:13.203157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:13.203950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:13.204236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:13.205582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:13.213385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 650/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Apr 11 13:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:13.219262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.314981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806689c6-5a94-4aa2-aa65-b5553215df59 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:13.346000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:13.346812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:13.347090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:13.347359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:13.358769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:13.360200 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:13.376872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:13.378052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 628/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:13.384243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.487537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5301b-84f1-4911-923f-2f078ac7405c None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:13.520004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:13.520663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:13.520943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:13.521218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:13.521937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:13.522278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:13.523636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:13.534827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 651/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:13.540964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.643508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfa53a-cb09-40e6-96c4-04ef7145e361 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:13.680366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:13.681203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:13.681483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:13.681761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:13.690601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:13.692230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:13.707413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:03:13.708767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 629/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:03:13.716066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.823053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620225b-7bf4-4b9d-9801-2dae92349c34 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:13.859422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:13.860113 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:13.860430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:13.860675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:13.861540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:13.861852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:13.865560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:13.885191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 652/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Apr 11 13:03:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:13.891487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:13.992397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e65db-e105-4188-b505-1f49a41047e0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:14.026814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:14.027471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:14.027754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:14.028029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:14.095342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:14.096878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:14.191337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 630/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Apr 11 13:03:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:03:14.197539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:14.291901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8181ed-bb12-4677-ae30-9cf6b8447092 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:14.324291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:14.325077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:14.325408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:14.325682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:14.336787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:14.338210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:14.354804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:03:14.355964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 653/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:14.361744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:14.456770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8ba0-95b4-45ef-814a-964ea2348ab0 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:14.489886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:14.490570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:14.490850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:14.491122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:14.491836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:14.492139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:14.493732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:14.504464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 631/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Apr 11 13:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:14.510256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:14.606618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e41fd-459e-4adc-9464-889ff33427af None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:14.638364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:14.639150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:14.639431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:14.639732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:14.646132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:14.647564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:14.661050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING keystone.server.flask.application [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:03:14.662262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 654/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Apr 11 13:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:03:14.668875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:14.764026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ec036-0f81-42bb-8db6-3b944470746d None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:14.795945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:14.796626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:14.796904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:14.797173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:14.797947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:14.798281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:14.799693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efdbb1-a1e0-4e8c-9a35-e61fc3c6814e None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:14.811194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 632/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Apr 11 13:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:14.817321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:14.915531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4500-8583-4895-8c6b-c776da0cda13 None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:14.947155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:14.947799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:14.948078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:14.948354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:14.949287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] RBAC: Adding query filter params (role.id=278a0b419dab4b198abcf738011cdca6, scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7, user.id=e5fb9818914042078c9fe53bfa51e6f4) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:14.949591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:14.951023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1b937-868c-4696-8ab8-022f0391be68 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:14.956741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 655/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Apr 11 13:03:14 2022] GET /identity/v3/role_assignments?user.id=e5fb9818914042078c9fe53bfa51e6f4&scope.project.id=639c0c8a7c9e4390a007d1a82a290ab7&role.id=278a0b419dab4b198abcf738011cdca6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:17.262600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3454b6a-4403-4d0c-80c8-f428be6c702a None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:17.263147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3454b6a-4403-4d0c-80c8-f428be6c702a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:17.263147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3454b6a-4403-4d0c-80c8-f428be6c702a None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:17.264515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 633/1288] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:17.269664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:17.271704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:17.271704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:17.286659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:17.287829 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:17.351224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 656/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:17.374206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3454b6a-4403-4d0c-80c8-f428be6c702a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:17.476199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3454b6a-4403-4d0c-80c8-f428be6c702a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:17.508860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:17.509656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:17.509933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:17.510236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:17.510891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:17.512314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:17.523224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 13:03:17.524966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 634/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:03:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:17.532443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:17.626479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fd593-7da5-44e3-969a-d37d7096f9b8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:17.659510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:17.660167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:17.660445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:17.660716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:17.661421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:17.661724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:17.663167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db3a8-a92d-45bd-a8c4-70101eb7998a None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:17.668575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 657/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Apr 11 13:03:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:17.674660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:17.772641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e33a-2e64-4561-9994-a72799648bd1 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:17.805654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:17.806280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:17.806576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:17.806829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] PATH_INFO: `/v3/services` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:17.807536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:17.807837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:17.809189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb693ce-63d6-4734-9ee6-1c502e6de7f9 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:17.813566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 635/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Apr 11 13:03:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:20.053006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690933-74d2-4031-8751-236ff95bf948 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:20.053597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690933-74d2-4031-8751-236ff95bf948 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:20.053597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690933-74d2-4031-8751-236ff95bf948 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:20.055173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 658/1293] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:20.060584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fa9d-ac32-4677-96dd-d20fcee1d2ca None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:20.061003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fa9d-ac32-4677-96dd-d20fcee1d2ca None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:20.061142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fa9d-ac32-4677-96dd-d20fcee1d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:20.078179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1f12fa9d-ac32-4677-96dd-d20fcee1d2ca None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:20.079402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1f12fa9d-ac32-4677-96dd-d20fcee1d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:20.143391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 636/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:20.168255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690933-74d2-4031-8751-236ff95bf948 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:20.267427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690933-74d2-4031-8751-236ff95bf948 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:20.300375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012d3e-a032-48b1-bb57-ab9e05aca115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:20.301029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012d3e-a032-48b1-bb57-ab9e05aca115 None admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:20.301310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012d3e-a032-48b1-bb57-ab9e05aca115 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:20.301587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012d3e-a032-48b1-bb57-ab9e05aca115 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:20.302445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012d3e-a032-48b1-bb57-ab9e05aca115 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:20.303849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012d3e-a032-48b1-bb57-ab9e05aca115 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:20.366282 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 659/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Apr 11 13:03:20 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:03:22.631094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85139ba5-a0ed-4358-8d29-c18cc1c2c638 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:22.631641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85139ba5-a0ed-4358-8d29-c18cc1c2c638 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:22.631641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85139ba5-a0ed-4358-8d29-c18cc1c2c638 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:22.633680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 637/1296] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:22.638877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:22.639285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:22.639391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:22.656483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:22.657670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:22.727184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 660/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:22.751069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85139ba5-a0ed-4358-8d29-c18cc1c2c638 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:22.846737 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85139ba5-a0ed-4358-8d29-c18cc1c2c638 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:22.879458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:22.880244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:22.880525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:22.880795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:22.881437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:22.882985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:22.893883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 13:03:22.895017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 638/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:03:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:22.901500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:22.995856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c569923-fe47-4935-a0da-8f62f4ac02bd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:23.027800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:23.028495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:23.028770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:23.029042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:23.029739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:23.030056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:23.031477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:23.036524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 661/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Apr 11 13:03:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:23.043043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:23.138569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeb4e1-bc69-4a7a-a3ff-dc2266770d31 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:23.170546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:23.171129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:23.171407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:23.171727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:23.172822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] RBAC: Adding query filter params (interface=public, service_id=f36bb3138e1749dc9b08a714cd455c0b, region_id=RegionOne) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:23.173358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:23.174837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc8fa-fc89-4d77-8543-7b532fc94b39 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:23.180375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 639/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Apr 11 13:03:23 2022] GET /identity/v3/endpoints?service_id=f36bb3138e1749dc9b08a714cd455c0b&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:23.185871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:23.280312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ceefb-0496-45ff-ba5a-e8f109fdbefe None admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:23.312387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fde4c6-3c83-4f23-8b08-07ff517fc54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:23.313036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde4c6-3c83-4f23-8b08-07ff517fc54e None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:23.313314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde4c6-3c83-4f23-8b08-07ff517fc54e None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:23.313584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde4c6-3c83-4f23-8b08-07ff517fc54e None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:23.314287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fde4c6-3c83-4f23-8b08-07ff517fc54e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:23.315631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fde4c6-3c83-4f23-8b08-07ff517fc54e None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:23.322485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 662/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Apr 11 13:03:23 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:03:25.617786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c725c8d-eda1-4c53-951c-d9863a3a170e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:25.618363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c725c8d-eda1-4c53-951c-d9863a3a170e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:25.618363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c725c8d-eda1-4c53-951c-d9863a3a170e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:25.619727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 640/1302] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:03:25.624740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:25.625174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:25.625284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:25.642756 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:03:25.643891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:03:25.707591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 663/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:03:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:03:25.732212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c725c8d-eda1-4c53-951c-d9863a3a170e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:25.828819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c725c8d-eda1-4c53-951c-d9863a3a170e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:25.860389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:25.861170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:25.861446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:25.861715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:25.862381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:25.863727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:25.874994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING keystone.server.flask.application [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 13:03:25.876155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 641/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Apr 11 13:03:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:03:25.882206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:25.976894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb7dd1-d86b-435a-bc0c-5a297a8999cb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:26.010520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:26.011187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:26.011471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:26.011746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] PATH_INFO: `/v3/services` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:26.012450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:03:26.012755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:26.014125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9943e-80fd-469d-a3fe-639e8fe89f29 None admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:26.019142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 664/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Apr 11 13:03:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:03:26.024828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:03:26.120335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cecc5-db33-4c92-9d48-974e7f394c86 None admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:03:26.152052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be8f3d-41cc-4900-98b6-5b6ff54db4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:03:26.152694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8f3d-41cc-4900-98b6-5b6ff54db4c1 None admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:03:26.152972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8f3d-41cc-4900-98b6-5b6ff54db4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:03:26.153243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8f3d-41cc-4900-98b6-5b6ff54db4c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:03:26.154048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be8f3d-41cc-4900-98b6-5b6ff54db4c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:03:26.155422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be8f3d-41cc-4900-98b6-5b6ff54db4c1 None admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:03:26.235146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 642/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Apr 11 13:03:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:09:26.002048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307efda-7722-444d-9b8f-5cb908d224e3 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:26.002623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307efda-7722-444d-9b8f-5cb908d224e3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:26.002623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307efda-7722-444d-9b8f-5cb908d224e3 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:26.007171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 665/1307] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:26.015209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f11b8-16e9-4c59-8a13-777f2c2add4b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:26.015209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f11b8-16e9-4c59-8a13-777f2c2add4b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:26.015209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f11b8-16e9-4c59-8a13-777f2c2add4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:26.122132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-199f11b8-16e9-4c59-8a13-777f2c2add4b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:26.124411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-199f11b8-16e9-4c59-8a13-777f2c2add4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:26.258735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 643/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:26.300174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47038e-a997-4e19-a122-97f3b92720de None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:26.300587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47038e-a997-4e19-a122-97f3b92720de None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:26.304643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47038e-a997-4e19-a122-97f3b92720de None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:26.304643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 666/1309] 10.222.0.49 () {54 vars in 963 bytes} [Mon Apr 11 13:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:26.309267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5bc49-2966-42db-bc3a-13436549c5fc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:26.309764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5bc49-2966-42db-bc3a-13436549c5fc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:26.310042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5bc49-2966-42db-bc3a-13436549c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:26.399021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-17a5bc49-2966-42db-bc3a-13436549c5fc None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:26.400217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-17a5bc49-2966-42db-bc3a-13436549c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:26.475678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 644/1310] 10.222.0.49 () {58 vars in 1060 bytes} [Mon Apr 11 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:26.485338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47038e-a997-4e19-a122-97f3b92720de None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:26.487318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9c47038e-a997-4e19-a122-97f3b92720de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:26.605789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47038e-a997-4e19-a122-97f3b92720de None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:26.680643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:26.681306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:26.681588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:26.681861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:26.683540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:26.793298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:26.794776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8237a-ee57-4d47-80bc-efff52c520d1 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:26.813912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 667/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:09:29.424918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6412a5-9ab9-448e-a7c8-130a6bcc9862 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:29.425402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6412a5-9ab9-448e-a7c8-130a6bcc9862 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:29.425518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6412a5-9ab9-448e-a7c8-130a6bcc9862 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:29.427479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 645/1312] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:29.432337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd36a8-8b76-4840-9873-b73d55925ce7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:29.432761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd36a8-8b76-4840-9873-b73d55925ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:29.432909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd36a8-8b76-4840-9873-b73d55925ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:29.541597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e5dd36a8-8b76-4840-9873-b73d55925ce7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:29.543104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5dd36a8-8b76-4840-9873-b73d55925ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:29.656471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 668/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:29.690776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6412a5-9ab9-448e-a7c8-130a6bcc9862 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:29.692291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5a6412a5-9ab9-448e-a7c8-130a6bcc9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:29.809279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6412a5-9ab9-448e-a7c8-130a6bcc9862 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:29.890284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:29.890935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:29.891219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:29.891500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:29.893231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:30.007340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:30.008871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9eda7-9bbe-4006-8941-5df77c353dca service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:30.027071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 646/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:32.873527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf6f6-6066-4d29-acfb-2460f88f1587 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:32.874369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf6f6-6066-4d29-acfb-2460f88f1587 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:32.874369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf6f6-6066-4d29-acfb-2460f88f1587 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:32.875767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 669/1315] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:32.880984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d6a5-0037-45b1-8e97-8de97b925c35 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:32.881389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d6a5-0037-45b1-8e97-8de97b925c35 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:32.881539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d6a5-0037-45b1-8e97-8de97b925c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:32.943983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8155d6a5-0037-45b1-8e97-8de97b925c35 None None] MFA Rules not processed for user `8177e42a8d794e678748d23f4f8acf32`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:32.945172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8155d6a5-0037-45b1-8e97-8de97b925c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:33.036351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 647/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:33.078067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcf6f6-6066-4d29-acfb-2460f88f1587 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:33.079615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77dcf6f6-6066-4d29-acfb-2460f88f1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:33.177316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcf6f6-6066-4d29-acfb-2460f88f1587 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:33.246776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:33.247416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:33.247696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:33.247972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:33.250151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:33.351917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:33.353335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9c856-e2a6-4ce4-b13c-7e00d95c0613 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:33.371321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 670/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:36.426421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131cee7-55a1-4d91-bc0a-988686c4bbc8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:36.426929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131cee7-55a1-4d91-bc0a-988686c4bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:36.427038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131cee7-55a1-4d91-bc0a-988686c4bbc8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:36.428360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 648/1318] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:36.433395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f863-f073-4b29-a40c-068054770b43 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:36.433828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f863-f073-4b29-a40c-068054770b43 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:36.433946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f863-f073-4b29-a40c-068054770b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:36.496210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ec78f863-f073-4b29-a40c-068054770b43 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:36.497321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ec78f863-f073-4b29-a40c-068054770b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:36.588413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 671/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:36.629262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131cee7-55a1-4d91-bc0a-988686c4bbc8 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:36.630825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d131cee7-55a1-4d91-bc0a-988686c4bbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:36.731076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131cee7-55a1-4d91-bc0a-988686c4bbc8 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:36.802456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:36.803096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:36.803375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:36.803646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:36.805270 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:36.908148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:36.909569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d25f6-98ab-4ed6-8122-c7bd63a40eb9 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:36.927832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 649/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:40.244683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05844-236b-4156-8f21-bcd4e6a9b57e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:40.245193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05844-236b-4156-8f21-bcd4e6a9b57e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:40.245302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05844-236b-4156-8f21-bcd4e6a9b57e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:40.246719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 672/1321] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:40.253874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f172a-1d15-407d-ae67-18856c04afb1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:40.253874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f172a-1d15-407d-ae67-18856c04afb1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:40.253874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f172a-1d15-407d-ae67-18856c04afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:40.316898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-797f172a-1d15-407d-ae67-18856c04afb1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:40.318091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-797f172a-1d15-407d-ae67-18856c04afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:40.412876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 650/1322] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:40.449623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b05844-236b-4156-8f21-bcd4e6a9b57e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:40.451198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-60b05844-236b-4156-8f21-bcd4e6a9b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:40.556463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b05844-236b-4156-8f21-bcd4e6a9b57e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:40.627045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:40.627705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:40.627985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:40.628256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:40.629891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:40.737492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:40.738954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2d4a-610f-4124-8636-3b4c85daea42 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:40.756614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 673/1323] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:43.173379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70cbb2-235f-4b37-8604-ab5b77df6156 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:43.173911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70cbb2-235f-4b37-8604-ab5b77df6156 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:43.173911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70cbb2-235f-4b37-8604-ab5b77df6156 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:43.175350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 651/1324] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:43.180581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93399313-66d1-4c96-a019-2f1cb88f7d0c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:43.180967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93399313-66d1-4c96-a019-2f1cb88f7d0c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:43.181142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93399313-66d1-4c96-a019-2f1cb88f7d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:43.247912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-93399313-66d1-4c96-a019-2f1cb88f7d0c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:43.249164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-93399313-66d1-4c96-a019-2f1cb88f7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:43.350177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 674/1325] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:43.388393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70cbb2-235f-4b37-8604-ab5b77df6156 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:43.390061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-da70cbb2-235f-4b37-8604-ab5b77df6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:43.493678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70cbb2-235f-4b37-8604-ab5b77df6156 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:43.565616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:43.566287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:43.566572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:43.566845 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:43.568477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:43.683250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:43.684688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb5d91-da74-4aad-b0a7-24d3caca031c service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:43.702548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 652/1326] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:46.120989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839791e-bf5f-454b-8fd5-d0a5f4cbd556 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:46.121650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839791e-bf5f-454b-8fd5-d0a5f4cbd556 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:46.121650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839791e-bf5f-454b-8fd5-d0a5f4cbd556 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:46.122994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 675/1327] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:46.128408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87548-ba31-4705-a8b9-d0edda92c870 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:46.128824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87548-ba31-4705-a8b9-d0edda92c870 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:46.128969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87548-ba31-4705-a8b9-d0edda92c870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:46.192558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9ab87548-ba31-4705-a8b9-d0edda92c870 None None] MFA Rules not processed for user `8177e42a8d794e678748d23f4f8acf32`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:46.193745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9ab87548-ba31-4705-a8b9-d0edda92c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:46.290029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 653/1328] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:46.344859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c405-e015-4acb-acd1-9ad22ed7c97c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:46.345192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c405-e015-4acb-acd1-9ad22ed7c97c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:46.345469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c405-e015-4acb-acd1-9ad22ed7c97c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:46.346889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 676/1329] 10.222.0.49 () {54 vars in 963 bytes} [Mon Apr 11 13:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:09:46.353014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaffd70-756c-42ee-8dbd-ecee3b1c2eed None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:46.353379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaffd70-756c-42ee-8dbd-ecee3b1c2eed None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:46.353726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaffd70-756c-42ee-8dbd-ecee3b1c2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:46.430649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ddaffd70-756c-42ee-8dbd-ecee3b1c2eed None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:46.431886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ddaffd70-756c-42ee-8dbd-ecee3b1c2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:46.506214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 654/1330] 10.222.0.49 () {58 vars in 1060 bytes} [Mon Apr 11 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:46.515169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c405-e015-4acb-acd1-9ad22ed7c97c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:46.517190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2469c405-e015-4acb-acd1-9ad22ed7c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:46.616603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c405-e015-4acb-acd1-9ad22ed7c97c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:46.687533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:46.688091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:46.688374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:46.688649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:46.690350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:46.795098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:46.796530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcd348-40cf-4ee0-8b4a-03dfed394831 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:46.814797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 677/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:49.978457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977a201-f290-492d-9c0f-206f087e33c2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:49.978954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977a201-f290-492d-9c0f-206f087e33c2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:49.978954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977a201-f290-492d-9c0f-206f087e33c2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:49.980337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 655/1332] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:49.986566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bf4d6-bb20-4f22-9a5a-35f8f91604a1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:49.987025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bf4d6-bb20-4f22-9a5a-35f8f91604a1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:49.987278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bf4d6-bb20-4f22-9a5a-35f8f91604a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:50.062026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f18bf4d6-bb20-4f22-9a5a-35f8f91604a1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:50.063939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f18bf4d6-bb20-4f22-9a5a-35f8f91604a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:50.163572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 678/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:09:50.200186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977a201-f290-492d-9c0f-206f087e33c2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:50.201690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6977a201-f290-492d-9c0f-206f087e33c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:50.318368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977a201-f290-492d-9c0f-206f087e33c2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:50.400708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:50.401358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:50.401636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:50.401906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:50.403603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:50.521090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:50.521743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b9aa1-bebb-41bc-bd76-0a176d073d1f service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:50.541895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 656/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:52.923246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9b73d-8d88-4b06-9437-c65c34cee396 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:52.923804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9b73d-8d88-4b06-9437-c65c34cee396 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:52.923804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9b73d-8d88-4b06-9437-c65c34cee396 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:52.925290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 679/1335] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:52.930458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289e1e-0791-4682-9589-bae1d1055857 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:52.930867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289e1e-0791-4682-9589-bae1d1055857 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:52.931015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289e1e-0791-4682-9589-bae1d1055857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:52.998154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3c289e1e-0791-4682-9589-bae1d1055857 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:52.999358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3c289e1e-0791-4682-9589-bae1d1055857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:53.093861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 657/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:53.134896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9b73d-8d88-4b06-9437-c65c34cee396 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:53.136416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-70f9b73d-8d88-4b06-9437-c65c34cee396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:53.236239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9b73d-8d88-4b06-9437-c65c34cee396 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:53.304929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:53.305574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:53.305850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:53.306139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:53.307757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:53.415022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:53.416430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551c7d-47cd-454a-a3cc-d32464694504 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:53.434134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 680/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:09:56.389466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d5d97-53bf-45c1-8719-76d87b7d3aa0 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:56.389858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d5d97-53bf-45c1-8719-76d87b7d3aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:56.390021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d5d97-53bf-45c1-8719-76d87b7d3aa0 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:56.392105 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 658/1338] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:09:56.397676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302ce2-c192-4912-88c9-020657171e9f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:56.398166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302ce2-c192-4912-88c9-020657171e9f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:56.398272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302ce2-c192-4912-88c9-020657171e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:56.462280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-05302ce2-c192-4912-88c9-020657171e9f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:09:56.463466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-05302ce2-c192-4912-88c9-020657171e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:56.567114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 681/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:09:56.603110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d5d97-53bf-45c1-8719-76d87b7d3aa0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:09:56.605229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-261d5d97-53bf-45c1-8719-76d87b7d3aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:09:56.714929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d5d97-53bf-45c1-8719-76d87b7d3aa0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:09:56.719181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6e457-b447-4fba-85b2-ec504c9bdce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:09:56.719820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e457-b447-4fba-85b2-ec504c9bdce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:09:56.720100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e457-b447-4fba-85b2-ec504c9bdce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:09:56.720397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6e457-b447-4fba-85b2-ec504c9bdce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:09:56.804639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e457-b447-4fba-85b2-ec504c9bdce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:09:56.806059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6e457-b447-4fba-85b2-ec504c9bdce3 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:09:56.824382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 659/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:01.563433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90439-73a1-4c93-a139-ea883580d7a8 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:01.563984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90439-73a1-4c93-a139-ea883580d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:01.563984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90439-73a1-4c93-a139-ea883580d7a8 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:01.565381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 682/1341] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:01.570970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221914d-d955-4da3-86ad-71c78f6fad0b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:01.571396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221914d-d955-4da3-86ad-71c78f6fad0b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:01.571574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221914d-d955-4da3-86ad-71c78f6fad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:01.632646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7221914d-d955-4da3-86ad-71c78f6fad0b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:01.633789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7221914d-d955-4da3-86ad-71c78f6fad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:01.708797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 660/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:01.749392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90439-73a1-4c93-a139-ea883580d7a8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:01.751684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8bc90439-73a1-4c93-a139-ea883580d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:01.764665 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90439-73a1-4c93-a139-ea883580d7a8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:01.768707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655b3f-212b-41c9-818c-f7ce0af9f82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:01.769346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655b3f-212b-41c9-818c-f7ce0af9f82e service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:01.769627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655b3f-212b-41c9-818c-f7ce0af9f82e service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:01.769904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655b3f-212b-41c9-818c-f7ce0af9f82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:01.778631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655b3f-212b-41c9-818c-f7ce0af9f82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:01.780082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655b3f-212b-41c9-818c-f7ce0af9f82e service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:01.789669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 683/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:05.131507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0cc1a-ea9a-458a-b3d4-d59a51bd13f4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:05.132075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0cc1a-ea9a-458a-b3d4-d59a51bd13f4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:05.132075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0cc1a-ea9a-458a-b3d4-d59a51bd13f4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:05.133482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 661/1344] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:05.138849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862fb5-4327-418e-bcd6-b0b5ee8dd38c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:05.139252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862fb5-4327-418e-bcd6-b0b5ee8dd38c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:05.139586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862fb5-4327-418e-bcd6-b0b5ee8dd38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:05.168619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e5862fb5-4327-418e-bcd6-b0b5ee8dd38c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:05.169802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e5862fb5-4327-418e-bcd6-b0b5ee8dd38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:05.178538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 684/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:10:05.218787 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0cc1a-ea9a-458a-b3d4-d59a51bd13f4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:05.229804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0cc1a-ea9a-458a-b3d4-d59a51bd13f4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:05.233313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057ea7e-bff4-4b64-8790-6ec7a8fa4c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:05.234565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057ea7e-bff4-4b64-8790-6ec7a8fa4c34 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:05.234850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057ea7e-bff4-4b64-8790-6ec7a8fa4c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:05.235847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057ea7e-bff4-4b64-8790-6ec7a8fa4c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:05.244593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057ea7e-bff4-4b64-8790-6ec7a8fa4c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:05.246056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057ea7e-bff4-4b64-8790-6ec7a8fa4c34 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:05.256316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 662/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:09.792425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826dcf-2a0b-4fb1-8691-53aa229e33e4 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:09.792974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826dcf-2a0b-4fb1-8691-53aa229e33e4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:09.792974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826dcf-2a0b-4fb1-8691-53aa229e33e4 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:09.794442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 685/1347] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:09.799563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2861c5-6cf2-4e07-a043-d380607dc569 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:09.799982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2861c5-6cf2-4e07-a043-d380607dc569 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:09.800124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2861c5-6cf2-4e07-a043-d380607dc569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:09.817838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3c2861c5-6cf2-4e07-a043-d380607dc569 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:09.819051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3c2861c5-6cf2-4e07-a043-d380607dc569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:09.826947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 663/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:09.866627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826dcf-2a0b-4fb1-8691-53aa229e33e4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:09.877281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826dcf-2a0b-4fb1-8691-53aa229e33e4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:09.881777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93e68-ce40-4356-bdf6-29f1604be9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:09.882711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93e68-ce40-4356-bdf6-29f1604be9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:09.883099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93e68-ce40-4356-bdf6-29f1604be9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:09.883471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93e68-ce40-4356-bdf6-29f1604be9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:09.894127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b93e68-ce40-4356-bdf6-29f1604be9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:09.895555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b93e68-ce40-4356-bdf6-29f1604be9e9 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:09.904944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 686/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:15.453723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53f71d-647a-4e1e-b028-00dfa4d4e228 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:15.454686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53f71d-647a-4e1e-b028-00dfa4d4e228 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:15.455114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53f71d-647a-4e1e-b028-00dfa4d4e228 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:15.456972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 664/1350] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:10:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:15.462352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa31f-48af-46b6-8069-62176ffca7a2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:15.462764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa31f-48af-46b6-8069-62176ffca7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:15.468274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa31f-48af-46b6-8069-62176ffca7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:15.536147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c37aa31f-48af-46b6-8069-62176ffca7a2 None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:15.537592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c37aa31f-48af-46b6-8069-62176ffca7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:15.614479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 687/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:10:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:20.210212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f969d8-c4b6-483c-9ad8-1c3fdd7cdcb8 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:20.210805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f969d8-c4b6-483c-9ad8-1c3fdd7cdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:20.210805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f969d8-c4b6-483c-9ad8-1c3fdd7cdcb8 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:20.212431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 665/1352] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:20.217991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694628d8-4a1c-4c56-afd9-0ffbaaf18fb4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:20.218809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694628d8-4a1c-4c56-afd9-0ffbaaf18fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:20.218809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694628d8-4a1c-4c56-afd9-0ffbaaf18fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:20.237825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-694628d8-4a1c-4c56-afd9-0ffbaaf18fb4 None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:20.239064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-694628d8-4a1c-4c56-afd9-0ffbaaf18fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:20.248692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 688/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:21.608813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d1ea-c145-44c1-8e02-99b50116810f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:21.609360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d1ea-c145-44c1-8e02-99b50116810f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:21.609475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d1ea-c145-44c1-8e02-99b50116810f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:21.611082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 666/1354] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:21.616081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197615a-af6f-499a-aac1-2d9bb93c9a8a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:21.616500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197615a-af6f-499a-aac1-2d9bb93c9a8a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:21.616640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197615a-af6f-499a-aac1-2d9bb93c9a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:21.635062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4197615a-af6f-499a-aac1-2d9bb93c9a8a None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:21.636309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4197615a-af6f-499a-aac1-2d9bb93c9a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:21.645633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 689/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:10:25.652283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78a47-bd11-4e33-b7c2-9d86ae1ecb79 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:25.656381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78a47-bd11-4e33-b7c2-9d86ae1ecb79 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:25.656381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78a47-bd11-4e33-b7c2-9d86ae1ecb79 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:25.656381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 667/1356] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:25.660227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649de4e-82d4-49a3-8777-5ab3d47d9d3f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:25.660666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649de4e-82d4-49a3-8777-5ab3d47d9d3f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:25.660809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649de4e-82d4-49a3-8777-5ab3d47d9d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:25.681477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9649de4e-82d4-49a3-8777-5ab3d47d9d3f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:25.682825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9649de4e-82d4-49a3-8777-5ab3d47d9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:25.692024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 690/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:25.742062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce898-d409-4d9c-a258-cebad6b3cf37 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:25.742378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce898-d409-4d9c-a258-cebad6b3cf37 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:25.742654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce898-d409-4d9c-a258-cebad6b3cf37 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:25.744150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 668/1358] 10.222.0.49 () {54 vars in 960 bytes} [Mon Apr 11 13:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:25.749420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd38d3-cf3c-46da-9b1a-7a05e689c833 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:25.749826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd38d3-cf3c-46da-9b1a-7a05e689c833 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:25.751336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd38d3-cf3c-46da-9b1a-7a05e689c833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:25.803460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-38bd38d3-cf3c-46da-9b1a-7a05e689c833 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:25.805094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-38bd38d3-cf3c-46da-9b1a-7a05e689c833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:25.902007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bce898-d409-4d9c-a258-cebad6b3cf37 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:25.903222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 691/1359] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Apr 11 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:25.918137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bce898-d409-4d9c-a258-cebad6b3cf37 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:25.924639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f831662-1747-489e-aacc-3e4f34f28494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:25.925349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f831662-1747-489e-aacc-3e4f34f28494 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:25.925660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f831662-1747-489e-aacc-3e4f34f28494 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:25.925945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f831662-1747-489e-aacc-3e4f34f28494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:25.935135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f831662-1747-489e-aacc-3e4f34f28494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:25.937419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f831662-1747-489e-aacc-3e4f34f28494 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:25.948165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 669/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:28.507265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c617f30-9446-4f5e-88fe-8c9f182cb491 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:28.508167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c617f30-9446-4f5e-88fe-8c9f182cb491 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:28.509126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c617f30-9446-4f5e-88fe-8c9f182cb491 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:28.511292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 692/1361] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:28.516168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48302a5-aba3-4319-9bd5-b16c763862a2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:28.516617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48302a5-aba3-4319-9bd5-b16c763862a2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:28.516725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48302a5-aba3-4319-9bd5-b16c763862a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:28.537132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a48302a5-aba3-4319-9bd5-b16c763862a2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:28.538355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a48302a5-aba3-4319-9bd5-b16c763862a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:28.546961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 670/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:28.591888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c617f30-9446-4f5e-88fe-8c9f182cb491 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:28.606716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c617f30-9446-4f5e-88fe-8c9f182cb491 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:28.612951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c5b1e-c37b-48bd-b3d0-6d5e57470b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:28.613697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5b1e-c37b-48bd-b3d0-6d5e57470b18 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:28.614030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5b1e-c37b-48bd-b3d0-6d5e57470b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:28.614403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c5b1e-c37b-48bd-b3d0-6d5e57470b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:28.622787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c5b1e-c37b-48bd-b3d0-6d5e57470b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:28.624492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c5b1e-c37b-48bd-b3d0-6d5e57470b18 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:28.635209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 693/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:31.410884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978128f-778a-4000-aae0-5f96740d6dac None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:31.411367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978128f-778a-4000-aae0-5f96740d6dac None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:31.411490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978128f-778a-4000-aae0-5f96740d6dac None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:31.412815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 671/1364] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:31.418027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326ad0c-d93d-4e7c-a0e6-a417c465d8c8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:31.418442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326ad0c-d93d-4e7c-a0e6-a417c465d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:31.418618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326ad0c-d93d-4e7c-a0e6-a417c465d8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:31.436114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e326ad0c-d93d-4e7c-a0e6-a417c465d8c8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:31.437572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e326ad0c-d93d-4e7c-a0e6-a417c465d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:31.445508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 694/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:31.493039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470192-87f0-4a35-b879-cceec993c52d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:31.493413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470192-87f0-4a35-b879-cceec993c52d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:31.494070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470192-87f0-4a35-b879-cceec993c52d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:31.495560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 672/1366] 10.222.0.49 () {54 vars in 960 bytes} [Mon Apr 11 13:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:31.501552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29df3-8d79-46ec-bf26-4c66c8a986dd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:31.501847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29df3-8d79-46ec-bf26-4c66c8a986dd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:31.502160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29df3-8d79-46ec-bf26-4c66c8a986dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:31.520392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fad29df3-8d79-46ec-bf26-4c66c8a986dd None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:31.521582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fad29df3-8d79-46ec-bf26-4c66c8a986dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:31.530933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 695/1367] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Apr 11 13:10:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:31.538603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470192-87f0-4a35-b879-cceec993c52d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:31.555439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470192-87f0-4a35-b879-cceec993c52d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:31.562677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb0298-56b3-4f3e-96e0-766c2d791fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:31.562677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0298-56b3-4f3e-96e0-766c2d791fde service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:31.562900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0298-56b3-4f3e-96e0-766c2d791fde service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:31.563133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb0298-56b3-4f3e-96e0-766c2d791fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:31.575680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb0298-56b3-4f3e-96e0-766c2d791fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:31.578657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb0298-56b3-4f3e-96e0-766c2d791fde service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:31.599044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 673/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:34.024545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391431-c61d-4b98-aea4-09df1d3b7f66 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.025106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391431-c61d-4b98-aea4-09df1d3b7f66 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.025372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391431-c61d-4b98-aea4-09df1d3b7f66 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.026928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 696/1369] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:34.032784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e173-6997-42a7-b9fa-d4abae405d72 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.033212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e173-6997-42a7-b9fa-d4abae405d72 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.033369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347e173-6997-42a7-b9fa-d4abae405d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.052070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5347e173-6997-42a7-b9fa-d4abae405d72 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:34.053276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5347e173-6997-42a7-b9fa-d4abae405d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:34.061331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 674/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:34.137747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f759b0-4957-407c-a198-717d02193f73 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.138325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f759b0-4957-407c-a198-717d02193f73 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.138605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f759b0-4957-407c-a198-717d02193f73 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.140128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 697/1371] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:34.145536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000a2a-09e9-4daa-891c-4c66235a4eb9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.145822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000a2a-09e9-4daa-891c-4c66235a4eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.146115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000a2a-09e9-4daa-891c-4c66235a4eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.164700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2f000a2a-09e9-4daa-891c-4c66235a4eb9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:34.165918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f000a2a-09e9-4daa-891c-4c66235a4eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:34.174596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 675/1372] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:34.219821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f759b0-4957-407c-a198-717d02193f73 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:34.235511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f759b0-4957-407c-a198-717d02193f73 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:34.245404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308a999-48f1-46ab-ab65-58f2cf545a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:34.246052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308a999-48f1-46ab-ab65-58f2cf545a85 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.246368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308a999-48f1-46ab-ab65-58f2cf545a85 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.246647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308a999-48f1-46ab-ab65-58f2cf545a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.256573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308a999-48f1-46ab-ab65-58f2cf545a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:34.258192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308a999-48f1-46ab-ab65-58f2cf545a85 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:34.269286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 698/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:34.344603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c103-1eae-4165-96f8-b131e2482a68 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.345000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c103-1eae-4165-96f8-b131e2482a68 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.345380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c103-1eae-4165-96f8-b131e2482a68 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.347093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 676/1374] 10.222.0.49 () {54 vars in 962 bytes} [Mon Apr 11 13:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:34.353036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700709e5-0da4-4ecb-a909-1afa735cb151 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.354249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700709e5-0da4-4ecb-a909-1afa735cb151 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.354718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700709e5-0da4-4ecb-a909-1afa735cb151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.409106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-700709e5-0da4-4ecb-a909-1afa735cb151 None None] MFA Rules not processed for user `ebd82c17696d4a258748cc70ebc8569a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:34.410414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-700709e5-0da4-4ecb-a909-1afa735cb151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:34.478206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 699/1375] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Apr 11 13:10:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:34.479588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c103-1eae-4165-96f8-b131e2482a68 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:34.495792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c103-1eae-4165-96f8-b131e2482a68 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:34.500858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18854d4d-1d75-4271-aa5d-c3c0cd4b1a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:34.501879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854d4d-1d75-4271-aa5d-c3c0cd4b1a34 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:34.502583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854d4d-1d75-4271-aa5d-c3c0cd4b1a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:34.503853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18854d4d-1d75-4271-aa5d-c3c0cd4b1a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:34.516736 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18854d4d-1d75-4271-aa5d-c3c0cd4b1a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:34.518593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18854d4d-1d75-4271-aa5d-c3c0cd4b1a34 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:34.533154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 677/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:10:36.769413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700ca49-a0e1-421b-bb16-ecc7b0e9ac21 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:36.769931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700ca49-a0e1-421b-bb16-ecc7b0e9ac21 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:36.770029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700ca49-a0e1-421b-bb16-ecc7b0e9ac21 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:36.771384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 700/1377] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:36.776687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82c0b8-2b08-4852-b7cc-fbe7fe5450be None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:36.777115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82c0b8-2b08-4852-b7cc-fbe7fe5450be None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:36.777235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82c0b8-2b08-4852-b7cc-fbe7fe5450be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:36.795513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7e82c0b8-2b08-4852-b7cc-fbe7fe5450be None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:36.797326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7e82c0b8-2b08-4852-b7cc-fbe7fe5450be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:36.805454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 678/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:36.851257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700ca49-a0e1-421b-bb16-ecc7b0e9ac21 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:36.866575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700ca49-a0e1-421b-bb16-ecc7b0e9ac21 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:36.872135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca717e-e341-4913-9d8a-b54a7cfe4637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:36.873010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca717e-e341-4913-9d8a-b54a7cfe4637 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:36.873110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca717e-e341-4913-9d8a-b54a7cfe4637 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:36.873310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca717e-e341-4913-9d8a-b54a7cfe4637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:36.882578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca717e-e341-4913-9d8a-b54a7cfe4637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:36.884159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca717e-e341-4913-9d8a-b54a7cfe4637 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:36.894248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 701/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:39.351828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84baf43-3b20-440b-acc7-7bd8602db519 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:39.352369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84baf43-3b20-440b-acc7-7bd8602db519 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:39.352479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84baf43-3b20-440b-acc7-7bd8602db519 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:39.353833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 679/1380] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:10:39.359043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895b01-93cf-44d9-b7a8-f229cfed73f3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:39.359457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895b01-93cf-44d9-b7a8-f229cfed73f3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:39.359607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895b01-93cf-44d9-b7a8-f229cfed73f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:39.378271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c1895b01-93cf-44d9-b7a8-f229cfed73f3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:39.379501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c1895b01-93cf-44d9-b7a8-f229cfed73f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:39.389152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 702/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:39.435596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84baf43-3b20-440b-acc7-7bd8602db519 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:39.450391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84baf43-3b20-440b-acc7-7bd8602db519 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:39.456520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a46c13-dc14-47fe-8441-373cd49dd719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:39.457188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a46c13-dc14-47fe-8441-373cd49dd719 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:39.457471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a46c13-dc14-47fe-8441-373cd49dd719 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:39.457752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a46c13-dc14-47fe-8441-373cd49dd719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:39.466953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a46c13-dc14-47fe-8441-373cd49dd719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:39.468696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a46c13-dc14-47fe-8441-373cd49dd719 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:39.479235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 680/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:41.971416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bc438-5ca6-47c2-bf65-d78c3fb7f795 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:41.971942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bc438-5ca6-47c2-bf65-d78c3fb7f795 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:41.971942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bc438-5ca6-47c2-bf65-d78c3fb7f795 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:41.973344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 703/1383] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:41.978477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060998ec-79fd-496b-b1cf-263c3d27db1a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:41.979395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060998ec-79fd-496b-b1cf-263c3d27db1a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:41.979515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060998ec-79fd-496b-b1cf-263c3d27db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:41.998069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-060998ec-79fd-496b-b1cf-263c3d27db1a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:41.999801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-060998ec-79fd-496b-b1cf-263c3d27db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:42.007907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 681/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:42.052527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bc438-5ca6-47c2-bf65-d78c3fb7f795 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:42.068074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bc438-5ca6-47c2-bf65-d78c3fb7f795 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:42.073590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddbc98-4e8d-4f79-98b0-6f7b3ecd35ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:42.074338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddbc98-4e8d-4f79-98b0-6f7b3ecd35ec service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:42.074810 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddbc98-4e8d-4f79-98b0-6f7b3ecd35ec service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:42.075166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddbc98-4e8d-4f79-98b0-6f7b3ecd35ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:42.084828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddbc98-4e8d-4f79-98b0-6f7b3ecd35ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:42.087524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddbc98-4e8d-4f79-98b0-6f7b3ecd35ec service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:42.097804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 704/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:10:44.482913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa9d6-c510-4ec1-abfc-96b47fb43194 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:44.483751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa9d6-c510-4ec1-abfc-96b47fb43194 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:44.483751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa9d6-c510-4ec1-abfc-96b47fb43194 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:44.485493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 682/1386] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:44.491186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d92c-17cb-4c80-bb4e-87711f7adb94 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:44.491893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d92c-17cb-4c80-bb4e-87711f7adb94 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:44.491893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d92c-17cb-4c80-bb4e-87711f7adb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:44.510033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2f65d92c-17cb-4c80-bb4e-87711f7adb94 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:44.511207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2f65d92c-17cb-4c80-bb4e-87711f7adb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:44.520361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 705/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:44.565657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa9d6-c510-4ec1-abfc-96b47fb43194 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:44.583612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa9d6-c510-4ec1-abfc-96b47fb43194 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:44.590776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06f74-7b0e-4128-a134-6e97e52adce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:44.591556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06f74-7b0e-4128-a134-6e97e52adce1 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:44.591920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06f74-7b0e-4128-a134-6e97e52adce1 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:44.592274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06f74-7b0e-4128-a134-6e97e52adce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:44.603568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e06f74-7b0e-4128-a134-6e97e52adce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:44.605801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e06f74-7b0e-4128-a134-6e97e52adce1 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:44.619058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 683/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:47.864258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cdd4-5c8f-4889-aac5-e5f4d6b55c63 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:47.864856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cdd4-5c8f-4889-aac5-e5f4d6b55c63 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:47.864856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cdd4-5c8f-4889-aac5-e5f4d6b55c63 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:47.866551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 706/1389] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:47.873867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5bda3-49b8-49b1-90a7-6795c3ce8c74 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:47.875201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5bda3-49b8-49b1-90a7-6795c3ce8c74 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:47.875433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5bda3-49b8-49b1-90a7-6795c3ce8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:47.896121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fab5bda3-49b8-49b1-90a7-6795c3ce8c74 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:47.897313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fab5bda3-49b8-49b1-90a7-6795c3ce8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:47.905815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 684/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:47.956268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23cdd4-5c8f-4889-aac5-e5f4d6b55c63 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:47.972437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23cdd4-5c8f-4889-aac5-e5f4d6b55c63 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:47.978405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2e6f7-f45f-43d4-9a41-52be28b7b56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:47.979337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2e6f7-f45f-43d4-9a41-52be28b7b56c service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:47.979692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2e6f7-f45f-43d4-9a41-52be28b7b56c service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:47.979908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2e6f7-f45f-43d4-9a41-52be28b7b56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:47.989472 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2e6f7-f45f-43d4-9a41-52be28b7b56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:47.991328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2e6f7-f45f-43d4-9a41-52be28b7b56c service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:48.001969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 707/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:10:50.537259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7a7cc-28a7-4ab7-8866-d5c2adee61e0 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:50.537870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7a7cc-28a7-4ab7-8866-d5c2adee61e0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:50.537870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7a7cc-28a7-4ab7-8866-d5c2adee61e0 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:50.539298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 685/1392] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:50.544833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39b397-adb4-4480-bc10-44e9a7da8705 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:50.545290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39b397-adb4-4480-bc10-44e9a7da8705 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:50.545390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39b397-adb4-4480-bc10-44e9a7da8705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:50.563720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4c39b397-adb4-4480-bc10-44e9a7da8705 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:50.564900 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4c39b397-adb4-4480-bc10-44e9a7da8705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:50.572870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 708/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:50.618591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7a7cc-28a7-4ab7-8866-d5c2adee61e0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:50.633254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7a7cc-28a7-4ab7-8866-d5c2adee61e0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:50.638676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccbe9-c0bf-4bf3-ad3b-aeb8bc40f871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:50.639314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccbe9-c0bf-4bf3-ad3b-aeb8bc40f871 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:50.639625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccbe9-c0bf-4bf3-ad3b-aeb8bc40f871 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:50.639902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccbe9-c0bf-4bf3-ad3b-aeb8bc40f871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:50.648068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dccbe9-c0bf-4bf3-ad3b-aeb8bc40f871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:50.649643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dccbe9-c0bf-4bf3-ad3b-aeb8bc40f871 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:50.659316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 686/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:50.899170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb298-4f9f-48fb-91a7-27b39aa05c33 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:50.899507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb298-4f9f-48fb-91a7-27b39aa05c33 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:50.899726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb298-4f9f-48fb-91a7-27b39aa05c33 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:50.901176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 709/1395] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:50.907146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6857c-c773-4396-ac4c-bf5957725e8b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:50.907439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6857c-c773-4396-ac4c-bf5957725e8b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:50.907724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6857c-c773-4396-ac4c-bf5957725e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:50.927501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3cd6857c-c773-4396-ac4c-bf5957725e8b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:50.928751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3cd6857c-c773-4396-ac4c-bf5957725e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:50.937980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 687/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:50.997263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e12d8-9f8c-43a2-986a-f583eaf84b29 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:50.997703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e12d8-9f8c-43a2-986a-f583eaf84b29 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:50.998047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e12d8-9f8c-43a2-986a-f583eaf84b29 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:51.000355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 710/1397] 10.222.0.49 () {54 vars in 961 bytes} [Mon Apr 11 13:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:51.005911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5a3c-297b-495a-af8d-373e44dcf175 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:51.006236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5a3c-297b-495a-af8d-373e44dcf175 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:51.006520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5a3c-297b-495a-af8d-373e44dcf175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:51.058720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-203a5a3c-297b-495a-af8d-373e44dcf175 None None] MFA Rules not processed for user `31782b5628be41e0a17c08dc6f2fa229`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:51.059920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-203a5a3c-297b-495a-af8d-373e44dcf175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:51.119573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 688/1398] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Apr 11 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:51.127323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e12d8-9f8c-43a2-986a-f583eaf84b29 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:51.140595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e12d8-9f8c-43a2-986a-f583eaf84b29 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:51.144684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563b09-aae9-4a65-a783-84b3bfa668a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:51.145403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563b09-aae9-4a65-a783-84b3bfa668a3 service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:51.145906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563b09-aae9-4a65-a783-84b3bfa668a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:51.146484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563b09-aae9-4a65-a783-84b3bfa668a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:51.157062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563b09-aae9-4a65-a783-84b3bfa668a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:51.158520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563b09-aae9-4a65-a783-84b3bfa668a3 service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:51.167975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 711/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:51.752005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07fbfc-8324-444e-bc71-f7c1454b516c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:51.752503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07fbfc-8324-444e-bc71-f7c1454b516c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:51.752593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07fbfc-8324-444e-bc71-f7c1454b516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:51.800327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ea07fbfc-8324-444e-bc71-f7c1454b516c None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:51.801622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ea07fbfc-8324-444e-bc71-f7c1454b516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:51.864769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 689/1400] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:51.903816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1de5-f3d5-4e08-9898-0e7bd22d5dd2 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:51.904298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1de5-f3d5-4e08-9898-0e7bd22d5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:51.904395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1de5-f3d5-4e08-9898-0e7bd22d5dd2 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:51.906607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 712/1401] 10.222.0.49 () {54 vars in 942 bytes} [Mon Apr 11 13:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:51.912458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824ece-e5f5-4c46-a888-161fd33342e1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:51.912819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824ece-e5f5-4c46-a888-161fd33342e1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:51.913108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18824ece-e5f5-4c46-a888-161fd33342e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:51.962069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-18824ece-e5f5-4c46-a888-161fd33342e1 None None] MFA Rules not processed for user `9d78c88153b34e0191d934a30bcb1f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:51.963327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-18824ece-e5f5-4c46-a888-161fd33342e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:52.034916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 690/1402] 10.222.0.49 () {58 vars in 1039 bytes} [Mon Apr 11 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:10:52.043351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b1de5-f3d5-4e08-9898-0e7bd22d5dd2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:52.057221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b1de5-f3d5-4e08-9898-0e7bd22d5dd2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:52.062367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9c93f-c8c8-4596-a41d-c2ef8c91b3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:52.063090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9c93f-c8c8-4596-a41d-c2ef8c91b3ff service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:52.063437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9c93f-c8c8-4596-a41d-c2ef8c91b3ff service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:52.063718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9c93f-c8c8-4596-a41d-c2ef8c91b3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:52.072016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9c93f-c8c8-4596-a41d-c2ef8c91b3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:52.073571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9c93f-c8c8-4596-a41d-c2ef8c91b3ff service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:52.082055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 713/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:10:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:10:53.162978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1fa51-e52d-458d-a5fe-01d0a8f6a7b5 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:53.163573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1fa51-e52d-458d-a5fe-01d0a8f6a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:53.163573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1fa51-e52d-458d-a5fe-01d0a8f6a7b5 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:53.164910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 691/1404] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:53.170016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b97f-c27d-46f9-bfbc-187b7b1c9094 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:53.170476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b97f-c27d-46f9-bfbc-187b7b1c9094 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:53.170583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b97f-c27d-46f9-bfbc-187b7b1c9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:53.192507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0b82b97f-c27d-46f9-bfbc-187b7b1c9094 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:53.193738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0b82b97f-c27d-46f9-bfbc-187b7b1c9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:53.201770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 714/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:10:53.247890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1fa51-e52d-458d-a5fe-01d0a8f6a7b5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:53.262946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1fa51-e52d-458d-a5fe-01d0a8f6a7b5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:53.269335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f87de-23bf-47d8-95a3-8bbb9a277567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:53.269980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f87de-23bf-47d8-95a3-8bbb9a277567 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:53.270366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f87de-23bf-47d8-95a3-8bbb9a277567 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:53.270643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f87de-23bf-47d8-95a3-8bbb9a277567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:53.279150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f87de-23bf-47d8-95a3-8bbb9a277567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:53.281371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f87de-23bf-47d8-95a3-8bbb9a277567 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:53.292698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 692/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:10:55.816303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e141-98a3-4885-a6b1-c079b90ada65 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:55.816851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e141-98a3-4885-a6b1-c079b90ada65 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:55.816934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e141-98a3-4885-a6b1-c079b90ada65 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:55.818688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 715/1407] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:10:55.823649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01b7e-3386-4159-931d-b00053e92462 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:55.824099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01b7e-3386-4159-931d-b00053e92462 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:55.824382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01b7e-3386-4159-931d-b00053e92462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:55.843853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4ed01b7e-3386-4159-931d-b00053e92462 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:10:55.845160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4ed01b7e-3386-4159-931d-b00053e92462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:10:55.853371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 693/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:10:55.902262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e141-98a3-4885-a6b1-c079b90ada65 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:10:55.926441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e141-98a3-4885-a6b1-c079b90ada65 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:10:55.926441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e7a0d-27bd-49f0-a50f-384ae2d409b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:10:55.926441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7a0d-27bd-49f0-a50f-384ae2d409b4 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:10:55.926441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7a0d-27bd-49f0-a50f-384ae2d409b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:10:55.926894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7a0d-27bd-49f0-a50f-384ae2d409b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:10:55.934861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7a0d-27bd-49f0-a50f-384ae2d409b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:10:55.936563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7a0d-27bd-49f0-a50f-384ae2d409b4 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:10:55.954285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 716/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:16.649337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c1ec9-0758-4bb3-bd23-d6fe461d47b2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:16.649967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c1ec9-0758-4bb3-bd23-d6fe461d47b2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:16.649967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c1ec9-0758-4bb3-bd23-d6fe461d47b2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:16.651299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 694/1410] 10.222.0.49 () {54 vars in 918 bytes} [Mon Apr 11 13:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:16.657511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f4217-2e30-46a5-b2f6-1f1df1f50dc6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:16.657994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f4217-2e30-46a5-b2f6-1f1df1f50dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:16.658095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f4217-2e30-46a5-b2f6-1f1df1f50dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:16.678362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-911f4217-2e30-46a5-b2f6-1f1df1f50dc6 None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:16.679560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-911f4217-2e30-46a5-b2f6-1f1df1f50dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:16.688014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 717/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Apr 11 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:16.702856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918d6da-825f-4f26-9503-da4a7cf4b19b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:16.703142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918d6da-825f-4f26-9503-da4a7cf4b19b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:16.703417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918d6da-825f-4f26-9503-da4a7cf4b19b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:16.704791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 695/1412] 10.222.0.49 () {54 vars in 918 bytes} [Mon Apr 11 13:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:16.709494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c061-1385-417b-aee8-b0b655914326 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:16.709780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c061-1385-417b-aee8-b0b655914326 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:16.710055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c061-1385-417b-aee8-b0b655914326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:16.728133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6c31c061-1385-417b-aee8-b0b655914326 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:16.729441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6c31c061-1385-417b-aee8-b0b655914326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:16.738801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 718/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Apr 11 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:11:19.510263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be727c61-f0cb-4655-9915-1d292aaa41ec None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:19.510808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be727c61-f0cb-4655-9915-1d292aaa41ec None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:19.510808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be727c61-f0cb-4655-9915-1d292aaa41ec None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:19.512179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:19.518149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62ea08-e117-4b6a-8d23-9deba9832b64 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:19.518588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62ea08-e117-4b6a-8d23-9deba9832b64 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:19.518709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62ea08-e117-4b6a-8d23-9deba9832b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:19.536731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bf62ea08-e117-4b6a-8d23-9deba9832b64 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:19.537913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bf62ea08-e117-4b6a-8d23-9deba9832b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:19.545601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:19.588289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be727c61-f0cb-4655-9915-1d292aaa41ec None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:19.602131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be727c61-f0cb-4655-9915-1d292aaa41ec None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:19.607350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b037-3b52-4f1f-ae9b-1530c6aec1fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:19.608080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b037-3b52-4f1f-ae9b-1530c6aec1fa service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:19.608267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b037-3b52-4f1f-ae9b-1530c6aec1fa service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:19.608539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b037-3b52-4f1f-ae9b-1530c6aec1fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:19.616682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6b037-3b52-4f1f-ae9b-1530c6aec1fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:19.618279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6b037-3b52-4f1f-ae9b-1530c6aec1fa service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:19.627984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 697/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:20.972545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3974-2f21-4cf1-a45c-1c25bc5f1852 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:20.973116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3974-2f21-4cf1-a45c-1c25bc5f1852 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:20.973116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3974-2f21-4cf1-a45c-1c25bc5f1852 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:20.974544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:20.979551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd571ee-480f-449a-9766-edad5d9a8f8e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:20.979973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd571ee-480f-449a-9766-edad5d9a8f8e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:20.980096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd571ee-480f-449a-9766-edad5d9a8f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:20.997846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-bfd571ee-480f-449a-9766-edad5d9a8f8e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:20.999271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bfd571ee-480f-449a-9766-edad5d9a8f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:21.006956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:21.174804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3974-2f21-4cf1-a45c-1c25bc5f1852 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:21.189369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3974-2f21-4cf1-a45c-1c25bc5f1852 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:21.194735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef756552-1904-4515-9e51-ac27995736a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:21.195359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756552-1904-4515-9e51-ac27995736a7 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:21.195637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756552-1904-4515-9e51-ac27995736a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:21.195908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756552-1904-4515-9e51-ac27995736a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:21.204354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef756552-1904-4515-9e51-ac27995736a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:21.205910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef756552-1904-4515-9e51-ac27995736a7 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:21.214975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 721/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:22.526876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80689-7bba-47c4-92ca-1c2a246a027b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:22.527415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80689-7bba-47c4-92ca-1c2a246a027b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:22.527415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80689-7bba-47c4-92ca-1c2a246a027b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:22.528801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:22.534118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acedc7-79a5-42af-ac96-66798ba12483 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:22.534527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acedc7-79a5-42af-ac96-66798ba12483 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:22.534687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acedc7-79a5-42af-ac96-66798ba12483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:22.552660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f4acedc7-79a5-42af-ac96-66798ba12483 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:22.553853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4acedc7-79a5-42af-ac96-66798ba12483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:22.562170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:22.710744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c80689-7bba-47c4-92ca-1c2a246a027b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:22.725150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c80689-7bba-47c4-92ca-1c2a246a027b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:22.730394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424ffd-99d5-4f03-ad8e-12e9709e2262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:22.731049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424ffd-99d5-4f03-ad8e-12e9709e2262 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:22.731334 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424ffd-99d5-4f03-ad8e-12e9709e2262 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:22.731609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424ffd-99d5-4f03-ad8e-12e9709e2262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:22.740308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424ffd-99d5-4f03-ad8e-12e9709e2262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:22.741890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424ffd-99d5-4f03-ad8e-12e9709e2262 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:22.751252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 700/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:24.036198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2284893-540d-432a-a6de-61beabb40430 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:24.036770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2284893-540d-432a-a6de-61beabb40430 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:24.036770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2284893-540d-432a-a6de-61beabb40430 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:24.038149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:24.043013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4cff2-7c96-45e3-952a-73162b76227d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:24.043436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4cff2-7c96-45e3-952a-73162b76227d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:24.043596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4cff2-7c96-45e3-952a-73162b76227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:24.061790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4fa4cff2-7c96-45e3-952a-73162b76227d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:24.063177 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4fa4cff2-7c96-45e3-952a-73162b76227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:24.070993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:11:24.220877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2284893-540d-432a-a6de-61beabb40430 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:24.235480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2284893-540d-432a-a6de-61beabb40430 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:24.240991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04561eee-974d-4da5-9c7b-7984da6ee48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:24.241619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04561eee-974d-4da5-9c7b-7984da6ee48c service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:24.241898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04561eee-974d-4da5-9c7b-7984da6ee48c service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:24.242202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04561eee-974d-4da5-9c7b-7984da6ee48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:24.250624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04561eee-974d-4da5-9c7b-7984da6ee48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:24.252190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04561eee-974d-4da5-9c7b-7984da6ee48c service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:24.261346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 724/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:25.568071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d991514-e69d-4df2-b467-f5bab77e1392 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:25.568638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d991514-e69d-4df2-b467-f5bab77e1392 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:25.568638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d991514-e69d-4df2-b467-f5bab77e1392 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:25.570007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:25.575363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a0ae-a10a-455f-8fa0-a686adc8ed65 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:25.575815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a0ae-a10a-455f-8fa0-a686adc8ed65 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:25.575932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a0ae-a10a-455f-8fa0-a686adc8ed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:25.594152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3b57a0ae-a10a-455f-8fa0-a686adc8ed65 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:25.595334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3b57a0ae-a10a-455f-8fa0-a686adc8ed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:25.603108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:25.759619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d991514-e69d-4df2-b467-f5bab77e1392 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:25.774077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d991514-e69d-4df2-b467-f5bab77e1392 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:25.779595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694873f-1682-4f4c-a59e-841fbd9e1981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:25.780477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694873f-1682-4f4c-a59e-841fbd9e1981 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:25.780785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694873f-1682-4f4c-a59e-841fbd9e1981 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:25.781056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694873f-1682-4f4c-a59e-841fbd9e1981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:25.789588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694873f-1682-4f4c-a59e-841fbd9e1981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:25.791236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694873f-1682-4f4c-a59e-841fbd9e1981 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:25.800680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 703/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:27.105112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847feb61-dee7-4fa3-b870-f7aa98bd63db None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:27.105706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847feb61-dee7-4fa3-b870-f7aa98bd63db None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:27.105706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847feb61-dee7-4fa3-b870-f7aa98bd63db None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:27.107089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:27.112443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854e161-d442-4639-8654-66a140b81f43 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:27.112872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854e161-d442-4639-8654-66a140b81f43 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:27.112986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854e161-d442-4639-8654-66a140b81f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:27.131050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b854e161-d442-4639-8654-66a140b81f43 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:27.132220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b854e161-d442-4639-8654-66a140b81f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:27.140679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:27.291315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847feb61-dee7-4fa3-b870-f7aa98bd63db None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:27.305189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847feb61-dee7-4fa3-b870-f7aa98bd63db None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:27.310498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be586b-1ac9-4eaf-a749-5f4d5325ed95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:27.311618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be586b-1ac9-4eaf-a749-5f4d5325ed95 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:27.311898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be586b-1ac9-4eaf-a749-5f4d5325ed95 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:27.312159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be586b-1ac9-4eaf-a749-5f4d5325ed95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:27.319943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be586b-1ac9-4eaf-a749-5f4d5325ed95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:27.321489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be586b-1ac9-4eaf-a749-5f4d5325ed95 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:27.331195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 727/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:28.640780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a4cb-5ab2-4935-9022-3de6e9aa3360 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:28.641287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a4cb-5ab2-4935-9022-3de6e9aa3360 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:28.641287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a4cb-5ab2-4935-9022-3de6e9aa3360 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:28.642673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:28.647668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367e16-6619-45cb-a3d4-84dafa0f8234 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:28.648179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367e16-6619-45cb-a3d4-84dafa0f8234 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:28.648290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367e16-6619-45cb-a3d4-84dafa0f8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:28.666074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-af367e16-6619-45cb-a3d4-84dafa0f8234 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:28.667279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af367e16-6619-45cb-a3d4-84dafa0f8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:28.675767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:28.826415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750a4cb-5ab2-4935-9022-3de6e9aa3360 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:28.840855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750a4cb-5ab2-4935-9022-3de6e9aa3360 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:28.847238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42688866-f0ed-4aec-afff-1297f2e4fe83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:28.847882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42688866-f0ed-4aec-afff-1297f2e4fe83 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:28.848149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42688866-f0ed-4aec-afff-1297f2e4fe83 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:28.848423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42688866-f0ed-4aec-afff-1297f2e4fe83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:28.856195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42688866-f0ed-4aec-afff-1297f2e4fe83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:28.858494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42688866-f0ed-4aec-afff-1297f2e4fe83 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:28.867823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 706/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:30.184761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b0f02-abe0-45ae-824b-8c301f4346ce None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:30.185320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b0f02-abe0-45ae-824b-8c301f4346ce None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:30.185320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b0f02-abe0-45ae-824b-8c301f4346ce None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:30.187266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:30.192213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63983-2bb2-439e-bf5d-a7d6684e4240 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:30.192669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63983-2bb2-439e-bf5d-a7d6684e4240 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:30.192907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63983-2bb2-439e-bf5d-a7d6684e4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:30.211940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-28c63983-2bb2-439e-bf5d-a7d6684e4240 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:30.213111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-28c63983-2bb2-439e-bf5d-a7d6684e4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:30.221047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:30.369384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b0f02-abe0-45ae-824b-8c301f4346ce None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:30.383744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b0f02-abe0-45ae-824b-8c301f4346ce None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:30.389150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade55f4-3869-4e56-b6b2-109596218533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:30.390346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade55f4-3869-4e56-b6b2-109596218533 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:30.390628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade55f4-3869-4e56-b6b2-109596218533 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:30.390901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade55f4-3869-4e56-b6b2-109596218533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:30.399670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade55f4-3869-4e56-b6b2-109596218533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:30.401243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade55f4-3869-4e56-b6b2-109596218533 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:30.410660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 730/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:31.723129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b08c-ae4d-4ab7-a165-e61ef5ad01a4 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:31.723687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b08c-ae4d-4ab7-a165-e61ef5ad01a4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:31.723687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b08c-ae4d-4ab7-a165-e61ef5ad01a4 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:31.725098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:31.729921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bd3e8-24e7-42d3-9d4d-d53f26919d30 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:31.730392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bd3e8-24e7-42d3-9d4d-d53f26919d30 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:31.730499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bd3e8-24e7-42d3-9d4d-d53f26919d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:31.750345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a50bd3e8-24e7-42d3-9d4d-d53f26919d30 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:31.751532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a50bd3e8-24e7-42d3-9d4d-d53f26919d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:31.759268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:31.914221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b08c-ae4d-4ab7-a165-e61ef5ad01a4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:31.928839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b08c-ae4d-4ab7-a165-e61ef5ad01a4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:31.934080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e10f6-7a10-4e78-ab16-310e28edc6c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:31.934734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e10f6-7a10-4e78-ab16-310e28edc6c7 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:31.935013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e10f6-7a10-4e78-ab16-310e28edc6c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:31.935286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e10f6-7a10-4e78-ab16-310e28edc6c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:31.943161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e10f6-7a10-4e78-ab16-310e28edc6c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:31.944744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e10f6-7a10-4e78-ab16-310e28edc6c7 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:31.954441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 709/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:34.144476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b209-16fa-4413-8606-4663a529de81 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:34.148491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b209-16fa-4413-8606-4663a529de81 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:34.148491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b209-16fa-4413-8606-4663a529de81 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:34.148491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:34.151665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5313-03f4-426d-a7e7-3df764cab477 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:34.152085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5313-03f4-426d-a7e7-3df764cab477 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:34.152209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5313-03f4-426d-a7e7-3df764cab477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:34.169842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c98b5313-03f4-426d-a7e7-3df764cab477 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:34.171687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c98b5313-03f4-426d-a7e7-3df764cab477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:34.179412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:34.219554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b209-16fa-4413-8606-4663a529de81 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:34.230071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b209-16fa-4413-8606-4663a529de81 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:34.234140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edd2ca-c388-45b8-ad0b-07a66421372b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:34.234778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edd2ca-c388-45b8-ad0b-07a66421372b service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:34.235177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edd2ca-c388-45b8-ad0b-07a66421372b service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:34.235460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edd2ca-c388-45b8-ad0b-07a66421372b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:34.244254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edd2ca-c388-45b8-ad0b-07a66421372b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:34.245697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edd2ca-c388-45b8-ad0b-07a66421372b service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:34.255463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 733/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:36.774322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c883c-ef81-4cfa-b3bd-810de4d8f1c7 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:36.774892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c883c-ef81-4cfa-b3bd-810de4d8f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:36.774892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c883c-ef81-4cfa-b3bd-810de4d8f1c7 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:36.776277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:36.781663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99119c7-04b9-48b2-81bb-98bc3141885d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:36.782096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99119c7-04b9-48b2-81bb-98bc3141885d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:36.782238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99119c7-04b9-48b2-81bb-98bc3141885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:36.799842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f99119c7-04b9-48b2-81bb-98bc3141885d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:36.801018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f99119c7-04b9-48b2-81bb-98bc3141885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:36.808613 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:36.847107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c883c-ef81-4cfa-b3bd-810de4d8f1c7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:36.857460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c883c-ef81-4cfa-b3bd-810de4d8f1c7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:36.861660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9a6a-a6e5-45fa-8883-ae8e497dfb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:36.862570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9a6a-a6e5-45fa-8883-ae8e497dfb25 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:36.862847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9a6a-a6e5-45fa-8883-ae8e497dfb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:36.863112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9a6a-a6e5-45fa-8883-ae8e497dfb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:36.871550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a9a6a-a6e5-45fa-8883-ae8e497dfb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:36.872959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a9a6a-a6e5-45fa-8883-ae8e497dfb25 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:36.882803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 712/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:39.546611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561828d-043d-4db7-9eb4-51b46b04ba3b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:39.547174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561828d-043d-4db7-9eb4-51b46b04ba3b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:39.547174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561828d-043d-4db7-9eb4-51b46b04ba3b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:39.548537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:39.553829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d98da3-ef86-475e-8b44-19ff3249fa18 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:39.554285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d98da3-ef86-475e-8b44-19ff3249fa18 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:39.554428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d98da3-ef86-475e-8b44-19ff3249fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:39.571946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-90d98da3-ef86-475e-8b44-19ff3249fa18 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:39.573121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-90d98da3-ef86-475e-8b44-19ff3249fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:39.580986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:39.620829 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561828d-043d-4db7-9eb4-51b46b04ba3b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:39.631373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561828d-043d-4db7-9eb4-51b46b04ba3b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:39.634898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec240-d1aa-48af-b45e-5171f229ca3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:39.635468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec240-d1aa-48af-b45e-5171f229ca3a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:39.635747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec240-d1aa-48af-b45e-5171f229ca3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:39.636020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec240-d1aa-48af-b45e-5171f229ca3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:39.644679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec240-d1aa-48af-b45e-5171f229ca3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:39.646086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec240-d1aa-48af-b45e-5171f229ca3a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:39.655728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 736/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:42.067283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289833aa-303c-43cd-a3eb-f6b600732467 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:42.067923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289833aa-303c-43cd-a3eb-f6b600732467 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:42.067923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289833aa-303c-43cd-a3eb-f6b600732467 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:42.069227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:42.074357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71304b-666c-4c71-a059-7841900aa466 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:42.074789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71304b-666c-4c71-a059-7841900aa466 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:42.074915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71304b-666c-4c71-a059-7841900aa466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:42.092982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ae71304b-666c-4c71-a059-7841900aa466 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:42.094178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ae71304b-666c-4c71-a059-7841900aa466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:42.102005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:42.141586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289833aa-303c-43cd-a3eb-f6b600732467 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:42.152051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289833aa-303c-43cd-a3eb-f6b600732467 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:42.156110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b42c5d-db85-46b0-8d43-5c67d9cf7ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:42.156739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b42c5d-db85-46b0-8d43-5c67d9cf7ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:42.157024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b42c5d-db85-46b0-8d43-5c67d9cf7ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:42.157291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b42c5d-db85-46b0-8d43-5c67d9cf7ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:42.165932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b42c5d-db85-46b0-8d43-5c67d9cf7ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:42.167461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b42c5d-db85-46b0-8d43-5c67d9cf7ff9 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:42.176828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 715/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:44.518688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f9f59-b550-491c-bba4-8b52abc8205b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:44.519241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f9f59-b550-491c-bba4-8b52abc8205b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:44.519241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f9f59-b550-491c-bba4-8b52abc8205b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:44.520649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:44.525910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0d58d-cab6-49d0-b28c-721398fbe6af None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:44.526363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0d58d-cab6-49d0-b28c-721398fbe6af None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:44.526493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0d58d-cab6-49d0-b28c-721398fbe6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:44.545040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d0f0d58d-cab6-49d0-b28c-721398fbe6af None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:44.546711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d0f0d58d-cab6-49d0-b28c-721398fbe6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:44.554528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:44.594994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f9f59-b550-491c-bba4-8b52abc8205b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:44.605508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f9f59-b550-491c-bba4-8b52abc8205b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:44.609678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd034bd-39f0-4f46-b587-4807e7b06ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:44.610369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd034bd-39f0-4f46-b587-4807e7b06ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:44.610650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd034bd-39f0-4f46-b587-4807e7b06ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:44.610923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd034bd-39f0-4f46-b587-4807e7b06ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:44.619827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd034bd-39f0-4f46-b587-4807e7b06ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:44.621230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd034bd-39f0-4f46-b587-4807e7b06ec3 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:44.630310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 739/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:47.007621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28e7a7-19db-43e5-bcab-443e68de0ba2 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:47.008155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28e7a7-19db-43e5-bcab-443e68de0ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:47.008155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28e7a7-19db-43e5-bcab-443e68de0ba2 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:47.009557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:47.014771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049e2b-011b-472b-b654-2a9ac49e1b6c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:47.015162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049e2b-011b-472b-b654-2a9ac49e1b6c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:47.015327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049e2b-011b-472b-b654-2a9ac49e1b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:47.032260 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-77049e2b-011b-472b-b654-2a9ac49e1b6c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:47.033430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77049e2b-011b-472b-b654-2a9ac49e1b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:47.040999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:47.079599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28e7a7-19db-43e5-bcab-443e68de0ba2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:47.089944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28e7a7-19db-43e5-bcab-443e68de0ba2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:47.093452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaba0f1-ee64-4508-9719-061a8219d775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:47.094078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba0f1-ee64-4508-9719-061a8219d775 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:47.094407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba0f1-ee64-4508-9719-061a8219d775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:47.094684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba0f1-ee64-4508-9719-061a8219d775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:47.103293 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaba0f1-ee64-4508-9719-061a8219d775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:47.104711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaba0f1-ee64-4508-9719-061a8219d775 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:47.114780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 718/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:49.472947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527c62-7536-4790-b3dd-af026de3b5a9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:49.473477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527c62-7536-4790-b3dd-af026de3b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:49.473587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527c62-7536-4790-b3dd-af026de3b5a9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:49.474975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:49.480264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4f778-a031-413d-a583-4523818a71ea None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:49.480716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4f778-a031-413d-a583-4523818a71ea None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:49.480861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4f778-a031-413d-a583-4523818a71ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:49.499136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3fd4f778-a031-413d-a583-4523818a71ea None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:49.500345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3fd4f778-a031-413d-a583-4523818a71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:49.508797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:49.548388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527c62-7536-4790-b3dd-af026de3b5a9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:49.558730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527c62-7536-4790-b3dd-af026de3b5a9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:49.562782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08490-9ee0-42e0-8a26-09a83eadfdf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:49.563406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08490-9ee0-42e0-8a26-09a83eadfdf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:49.563685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08490-9ee0-42e0-8a26-09a83eadfdf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:49.563955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08490-9ee0-42e0-8a26-09a83eadfdf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:49.572410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec08490-9ee0-42e0-8a26-09a83eadfdf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:49.573802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec08490-9ee0-42e0-8a26-09a83eadfdf8 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:49.583419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 742/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:51.916355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e56-8813-4f92-ba54-42f3805ba3e5 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:51.916911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e56-8813-4f92-ba54-42f3805ba3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:51.916911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e56-8813-4f92-ba54-42f3805ba3e5 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:51.918355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:51.923783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213b40-7821-47d8-a3a4-de062a2ca9c3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:51.924220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213b40-7821-47d8-a3a4-de062a2ca9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:51.924328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213b40-7821-47d8-a3a4-de062a2ca9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:51.943281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5b213b40-7821-47d8-a3a4-de062a2ca9c3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:51.944461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5b213b40-7821-47d8-a3a4-de062a2ca9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:51.952797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:51.990524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826e56-8813-4f92-ba54-42f3805ba3e5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:52.001450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826e56-8813-4f92-ba54-42f3805ba3e5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:52.004917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d6fe8-287b-4519-906b-ad84550af7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:52.005541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d6fe8-287b-4519-906b-ad84550af7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:52.005820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d6fe8-287b-4519-906b-ad84550af7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:52.006090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d6fe8-287b-4519-906b-ad84550af7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:52.015357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d6fe8-287b-4519-906b-ad84550af7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:52.016765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d6fe8-287b-4519-906b-ad84550af7a8 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:52.025860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 721/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:54.386934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8da6-da01-46be-bd45-108520400477 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:54.387417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8da6-da01-46be-bd45-108520400477 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:54.387518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8da6-da01-46be-bd45-108520400477 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:54.388875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:54.394456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd79-9b85-4b63-aec1-6b1f5b2d1a48 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:54.394918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd79-9b85-4b63-aec1-6b1f5b2d1a48 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:54.395013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd79-9b85-4b63-aec1-6b1f5b2d1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:54.412708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1abecd79-9b85-4b63-aec1-6b1f5b2d1a48 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:54.413873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1abecd79-9b85-4b63-aec1-6b1f5b2d1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:54.422433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:54.461584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8da6-da01-46be-bd45-108520400477 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:54.472755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8da6-da01-46be-bd45-108520400477 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:54.476296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9db9d-8f7c-4ffd-93c3-0d8884137651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:54.477047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9db9d-8f7c-4ffd-93c3-0d8884137651 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:54.477333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9db9d-8f7c-4ffd-93c3-0d8884137651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:54.477608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9db9d-8f7c-4ffd-93c3-0d8884137651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:54.486786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9db9d-8f7c-4ffd-93c3-0d8884137651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:54.488484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9db9d-8f7c-4ffd-93c3-0d8884137651 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:54.497715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 745/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:11:56.808835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ded9c-8918-478f-bf8a-b329bb52edde None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:56.809428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ded9c-8918-478f-bf8a-b329bb52edde None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:56.809428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ded9c-8918-478f-bf8a-b329bb52edde None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:56.811518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:11:56.816825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50133ba-44fc-4ff1-9835-00bc5e6135a6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:56.817244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50133ba-44fc-4ff1-9835-00bc5e6135a6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:56.817351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50133ba-44fc-4ff1-9835-00bc5e6135a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:56.834409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e50133ba-44fc-4ff1-9835-00bc5e6135a6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:11:56.835577 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e50133ba-44fc-4ff1-9835-00bc5e6135a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:11:56.843241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:11:56.881463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ded9c-8918-478f-bf8a-b329bb52edde None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:11:56.891827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ded9c-8918-478f-bf8a-b329bb52edde None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:11:56.895280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0e9d-ab30-4992-9831-622d0bd3a827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:11:56.895904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0e9d-ab30-4992-9831-622d0bd3a827 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:11:56.896181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0e9d-ab30-4992-9831-622d0bd3a827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:11:56.896450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0e9d-ab30-4992-9831-622d0bd3a827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:11:56.905000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0e9d-ab30-4992-9831-622d0bd3a827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:11:56.906450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0e9d-ab30-4992-9831-622d0bd3a827 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:11:56.915549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 724/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:12:30.568259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13e15f-37fd-4d0b-98f9-4790c513e3e1 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:30.568825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13e15f-37fd-4d0b-98f9-4790c513e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:30.568825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13e15f-37fd-4d0b-98f9-4790c513e3e1 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:30.570179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 747/1471] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:30.575532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668890b-ed21-420a-891f-47e49b5e6735 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:30.576266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668890b-ed21-420a-891f-47e49b5e6735 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:30.576266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668890b-ed21-420a-891f-47e49b5e6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:30.593417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4668890b-ed21-420a-891f-47e49b5e6735 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:30.594629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4668890b-ed21-420a-891f-47e49b5e6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:30.602534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 725/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:30.650092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f76ba-31bc-4539-a950-176e38b4062d None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:30.650409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f76ba-31bc-4539-a950-176e38b4062d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:30.650689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f76ba-31bc-4539-a950-176e38b4062d None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:30.652062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 748/1473] 10.222.0.49 () {54 vars in 961 bytes} [Mon Apr 11 13:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:30.657164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494db6f-87f2-4c27-a8fa-43b47fd82243 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:30.657460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494db6f-87f2-4c27-a8fa-43b47fd82243 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:30.657741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494db6f-87f2-4c27-a8fa-43b47fd82243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:30.675830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0494db6f-87f2-4c27-a8fa-43b47fd82243 None None] MFA Rules not processed for user `31782b5628be41e0a17c08dc6f2fa229`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:30.677013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0494db6f-87f2-4c27-a8fa-43b47fd82243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:30.683590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 726/1474] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Apr 11 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:30.691442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f76ba-31bc-4539-a950-176e38b4062d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:30.701946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f76ba-31bc-4539-a950-176e38b4062d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:30.705490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67802-e9b5-499d-8be4-c9c0d32c1e40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:30.706142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67802-e9b5-499d-8be4-c9c0d32c1e40 service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:30.706436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67802-e9b5-499d-8be4-c9c0d32c1e40 service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:30.706710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67802-e9b5-499d-8be4-c9c0d32c1e40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:30.715299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67802-e9b5-499d-8be4-c9c0d32c1e40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:30.716946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67802-e9b5-499d-8be4-c9c0d32c1e40 service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:30.726100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 749/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:12:33.175209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cde7c-e109-4313-84cd-e2da71e49c3d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:33.175769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cde7c-e109-4313-84cd-e2da71e49c3d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:33.175769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cde7c-e109-4313-84cd-e2da71e49c3d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:33.177163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 727/1476] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:33.182877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d2e8b-fd3a-4edf-81f5-4eb19f98521f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:33.183710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d2e8b-fd3a-4edf-81f5-4eb19f98521f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:33.183710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d2e8b-fd3a-4edf-81f5-4eb19f98521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:33.202626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fb3d2e8b-fd3a-4edf-81f5-4eb19f98521f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:33.203800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fb3d2e8b-fd3a-4edf-81f5-4eb19f98521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:33.212168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 750/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:33.236808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cde7c-e109-4313-84cd-e2da71e49c3d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:33.249974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cde7c-e109-4313-84cd-e2da71e49c3d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:33.254430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:33.255080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:33.255357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:33.255629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:33.256362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:33.258051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:12:33.258051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:12:33.258051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:12:33.259203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d632-5513-432b-acc9-2b68035bcd77 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:33.278495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 728/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Apr 11 13:12:33 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:12:35.643554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561800d-aff1-4692-88c1-6a0962317139 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:35.644082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561800d-aff1-4692-88c1-6a0962317139 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:35.644082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561800d-aff1-4692-88c1-6a0962317139 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:35.645435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 751/1479] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:35.650838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5920-7127-41e7-8a88-500e248cc71d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:35.651391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5920-7127-41e7-8a88-500e248cc71d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:35.651391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5920-7127-41e7-8a88-500e248cc71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:35.669164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d08c5920-7127-41e7-8a88-500e248cc71d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:35.671614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d08c5920-7127-41e7-8a88-500e248cc71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:35.678597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 729/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:35.720950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561800d-aff1-4692-88c1-6a0962317139 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:35.735020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561800d-aff1-4692-88c1-6a0962317139 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:35.740764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95221cb7-020c-498f-8839-8df039ac0a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:35.741399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95221cb7-020c-498f-8839-8df039ac0a00 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:35.741683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95221cb7-020c-498f-8839-8df039ac0a00 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:35.741960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95221cb7-020c-498f-8839-8df039ac0a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:35.750517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95221cb7-020c-498f-8839-8df039ac0a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:35.752107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95221cb7-020c-498f-8839-8df039ac0a00 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:35.761595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 752/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:12:38.256395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b51f-f7bd-417a-9a56-5167dcbaf8ca None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:38.257043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b51f-f7bd-417a-9a56-5167dcbaf8ca None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:38.257043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b51f-f7bd-417a-9a56-5167dcbaf8ca None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:38.258355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 730/1482] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:38.264366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e11398-ccad-4666-94a3-74363bb26de5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:38.264856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e11398-ccad-4666-94a3-74363bb26de5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:38.265002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e11398-ccad-4666-94a3-74363bb26de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:38.282833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b6e11398-ccad-4666-94a3-74363bb26de5 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:38.284013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b6e11398-ccad-4666-94a3-74363bb26de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:38.291787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 753/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:12:38.328927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b51f-f7bd-417a-9a56-5167dcbaf8ca None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:38.339343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b51f-f7bd-417a-9a56-5167dcbaf8ca None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:38.342854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb141b7-5b4a-4a65-b498-1dc370fa4d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:38.343492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb141b7-5b4a-4a65-b498-1dc370fa4d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:38.343770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb141b7-5b4a-4a65-b498-1dc370fa4d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:38.344052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb141b7-5b4a-4a65-b498-1dc370fa4d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:38.352851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb141b7-5b4a-4a65-b498-1dc370fa4d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:38.354312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb141b7-5b4a-4a65-b498-1dc370fa4d21 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:38.364014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 731/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:12:40.755579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5c35-fbd9-4059-8258-8650e7a4f94c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:40.756106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5c35-fbd9-4059-8258-8650e7a4f94c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:40.756106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5c35-fbd9-4059-8258-8650e7a4f94c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:40.757464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 754/1485] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:40.762674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa9b9c-ae07-44f8-8162-65f772859a1a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:40.763199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa9b9c-ae07-44f8-8162-65f772859a1a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:40.763895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa9b9c-ae07-44f8-8162-65f772859a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:40.781680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b2fa9b9c-ae07-44f8-8162-65f772859a1a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:40.782908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b2fa9b9c-ae07-44f8-8162-65f772859a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:40.790833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 732/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:40.829366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5c35-fbd9-4059-8258-8650e7a4f94c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:40.839789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5c35-fbd9-4059-8258-8650e7a4f94c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:40.844026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd928-04d7-4353-8445-c1a1f797311c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:40.844660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd928-04d7-4353-8445-c1a1f797311c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:40.844940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd928-04d7-4353-8445-c1a1f797311c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:40.845213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd928-04d7-4353-8445-c1a1f797311c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:40.853778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd928-04d7-4353-8445-c1a1f797311c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:40.855299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd928-04d7-4353-8445-c1a1f797311c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:40.865378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 755/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:12:43.268988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f748b-5c8b-42dc-af56-200248a70c9d None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:43.269548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f748b-5c8b-42dc-af56-200248a70c9d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:43.269548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f748b-5c8b-42dc-af56-200248a70c9d None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:43.271335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 733/1488] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:43.276698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2eb8d-ab5e-4191-a447-8856a30ed48f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:43.277087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2eb8d-ab5e-4191-a447-8856a30ed48f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:43.277258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2eb8d-ab5e-4191-a447-8856a30ed48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:43.295643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d3f2eb8d-ab5e-4191-a447-8856a30ed48f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:43.296831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d3f2eb8d-ab5e-4191-a447-8856a30ed48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:43.304603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 756/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:43.344932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f748b-5c8b-42dc-af56-200248a70c9d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:43.355826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f748b-5c8b-42dc-af56-200248a70c9d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:43.359386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9c05c-d285-4a8f-8de2-766b41476d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:43.360048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9c05c-d285-4a8f-8de2-766b41476d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:43.360325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9c05c-d285-4a8f-8de2-766b41476d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:43.360599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9c05c-d285-4a8f-8de2-766b41476d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:43.369772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9c05c-d285-4a8f-8de2-766b41476d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:43.371229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9c05c-d285-4a8f-8de2-766b41476d93 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:43.380531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 734/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:12:46.157348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b2b43-7408-43cc-88d9-4041c996a8e6 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:46.157920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b2b43-7408-43cc-88d9-4041c996a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:46.157920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b2b43-7408-43cc-88d9-4041c996a8e6 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:46.159405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 757/1491] 10.222.0.49 () {54 vars in 926 bytes} [Mon Apr 11 13:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:12:46.164618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3d23-ded6-496c-9e8f-a2e6f975ab11 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:46.165052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3d23-ded6-496c-9e8f-a2e6f975ab11 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:46.165165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3d23-ded6-496c-9e8f-a2e6f975ab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:46.183528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-850b3d23-ded6-496c-9e8f-a2e6f975ab11 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:12:46.184709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-850b3d23-ded6-496c-9e8f-a2e6f975ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:12:46.192959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 735/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Apr 11 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:12:46.234802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b2b43-7408-43cc-88d9-4041c996a8e6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:12:46.245791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b2b43-7408-43cc-88d9-4041c996a8e6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:12:46.249746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8bc8-8a24-4df8-a9c2-6571dc455d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:12:46.250418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8bc8-8a24-4df8-a9c2-6571dc455d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:12:46.250700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8bc8-8a24-4df8-a9c2-6571dc455d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:12:46.250975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8bc8-8a24-4df8-a9c2-6571dc455d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:12:46.259797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8bc8-8a24-4df8-a9c2-6571dc455d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:12:46.261216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8bc8-8a24-4df8-a9c2-6571dc455d07 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:12:46.271261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 758/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:14:29.220216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.220813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.220813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.239381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:14:29.240809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:14:29.249373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 736/1494] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:14:29.257601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.258096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.258262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.277473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:14:29.279442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:14:29.287465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 759/1495] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:14:29.292175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:29.301988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5548f-cd93-4c1e-932b-e8cb06d7f547 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:29.306577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:29.307226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.307504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.307778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.308527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:14:29.308830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:29.310509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:29.310509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:14:29.310509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:14:29.311237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:29.323021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 737/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:14:29.332241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:29.341599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e91bf-55d5-41c6-95ea-a5c17d7b1a28 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:29.346249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:29.346966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.347292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.347573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.348263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:29.350057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:29.350057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:14:29.350057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:14:29.351264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:29.510993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 760/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:14:29.516023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:29.526252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75f4a-a7c5-4198-b9a5-98bf5586fabf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:29.583311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:29.583989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.584267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.584542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.585828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:29.586288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:29.586288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:14:29.586288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:14:29.587482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:29.681726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 738/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:14:29 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:14:29.686948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:29.697156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21dd52-89f3-4a55-9291-0fccabfc7879 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:29.701662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:29.702374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.702652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.702928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.703726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:29.704723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:29.704723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:14:29.704723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:14:29.705594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:29.718636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 761/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:14:29.723311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:29.734476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9a118-206d-456f-a45c-76aae1b297b2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:29.739183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:29.740135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.740135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.740440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.741425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:29.742479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:29.742479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:14:29.742479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:14:29.743366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9defc-5317-4c57-aab4-54f37e830462 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:29.758838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 739/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:14:29.763582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:29.773291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567c35f-c3d6-47dc-9bc9-7d327d13878c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:29.778864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:29.779752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.780030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.780298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] PATH_INFO: `/v3/projects/b590c78ac3d248ebbafabccd2fc735d8/users/09a1eb7a22144f78a6d12009658e86ce/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.795695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b590c78ac3d248ebbafabccd2fc735d8, user_id=09a1eb7a22144f78a6d12009658e86ce, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:29.796782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:29.796782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:14:29.796782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:14:29.798775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:29.859531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 762/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:14:29 2022] PUT /identity/v3/projects/b590c78ac3d248ebbafabccd2fc735d8/users/09a1eb7a22144f78a6d12009658e86ce/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:14:29.871767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfec55-7693-4a81-8a84-13d2470cc5be None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:29.873272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfec55-7693-4a81-8a84-13d2470cc5be None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:29.873272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfec55-7693-4a81-8a84-13d2470cc5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:29.900625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-18dfec55-7693-4a81-8a84-13d2470cc5be None None] MFA Rules not processed for user `09a1eb7a22144f78a6d12009658e86ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:14:29.906320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-18dfec55-7693-4a81-8a84-13d2470cc5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:14:29.966498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 740/1502] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:14:29.977708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:30.047717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe815e9-7521-4d47-ada0-a0888abe9196 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:30.053215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:30.053890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:30.054171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:30.054451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:30.062426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:30.064008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:30.072744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 763/1503] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:14:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:14:30.145417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cdd45-477c-40dd-9851-53808080d20e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:30.145781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cdd45-477c-40dd-9851-53808080d20e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:30.146065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cdd45-477c-40dd-9851-53808080d20e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:30.147608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 741/1504] 10.222.0.49 () {52 vars in 829 bytes} [Mon Apr 11 13:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:14:30.151294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:30.214951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1bfb3-aa57-4622-9c12-5ce3597dfcac service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:30.221378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:30.222412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:30.222742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:30.223023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] PATH_INFO: `/v3/users/09a1eb7a22144f78a6d12009658e86ce` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:30.224218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a1eb7a22144f78a6d12009658e86ce)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:30.225225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:30.225225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:14:30.225225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:14:30.226512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:30.693003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a1eb7a22144f78a6d12009658e86ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:30.755516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a1eb7a22144f78a6d12009658e86ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:30.769027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a1eb7a22144f78a6d12009658e86ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:30.789648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a1eb7a22144f78a6d12009658e86ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:30.790539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a1eb7a22144f78a6d12009658e86ce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:30.796732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 764/1505] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:14:30 2022] DELETE /identity/v3/users/09a1eb7a22144f78a6d12009658e86ce => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:14:30.801220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:30.801722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:30.801823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:30.820056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:14:30.821228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:14:30.881015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 742/1506] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:14:30.891223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:30.892647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:14:30.950050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b153-64c6-4021-aa3d-24abbbf39279 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:30.953860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82b584-b79b-427c-9583-60d6536b64c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:30.954566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b584-b79b-427c-9583-60d6536b64c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:30.954847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b584-b79b-427c-9583-60d6536b64c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:30.955122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b584-b79b-427c-9583-60d6536b64c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:30.963910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82b584-b79b-427c-9583-60d6536b64c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:30.965351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82b584-b79b-427c-9583-60d6536b64c2 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:30.975856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 765/1507] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:14:31.488413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:14:31.497821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:14:31.502206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79184-b116-4e42-bc51-e01396a90053 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:14:31.507684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:14:31.508629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:14:31.508980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:14:31.509343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] PATH_INFO: `/v3/projects/b590c78ac3d248ebbafabccd2fc735d8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:14:31.510652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b590c78ac3d248ebbafabccd2fc735d8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:14:31.512051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:14:31.512051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:14:31.512051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:14:31.514007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:14:31.666001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b590c78ac3d248ebbafabccd2fc735d8', 'request_id': 'req-1c1b2100-2e05-4eca-92d6-15831b60a076'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:31.672790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b590c78ac3d248ebbafabccd2fc735d8', 'request_id': 'req-1c1b2100-2e05-4eca-92d6-15831b60a076'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:31.744036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b590c78ac3d248ebbafabccd2fc735d8', 'request_id': 'req-1c1b2100-2e05-4eca-92d6-15831b60a076'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:31.763195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] The token cache is being invalidate because project b590c78ac3d248ebbafabccd2fc735d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:14:31.763520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:31.764287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c1b2100-2e05-4eca-92d6-15831b60a076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:14:31.765991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 743/1508] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:14:31 2022] DELETE /identity/v3/projects/b590c78ac3d248ebbafabccd2fc735d8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:16:17.879596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5f2a7-c6e6-4923-8b05-2c35bc90dfa0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:17.880209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5f2a7-c6e6-4923-8b05-2c35bc90dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:17.880315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5f2a7-c6e6-4923-8b05-2c35bc90dfa0 None None] PATH_INFO: `/v3` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:17.881838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 766/1509] 10.222.0.50 () {54 vars in 925 bytes} [Mon Apr 11 13:16:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:16:17.888223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0e73-7ad4-4ad1-a86f-276febfbfb87 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:17.888691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0e73-7ad4-4ad1-a86f-276febfbfb87 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:17.888807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0e73-7ad4-4ad1-a86f-276febfbfb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:17.907840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d36b0e73-7ad4-4ad1-a86f-276febfbfb87 None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:17.909040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d36b0e73-7ad4-4ad1-a86f-276febfbfb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:17.976173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 744/1510] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Apr 11 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:18.189948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba6f7-0afc-4c74-b06f-873b4ae6dfd5 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:18.190266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba6f7-0afc-4c74-b06f-873b4ae6dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:18.190540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ba6f7-0afc-4c74-b06f-873b4ae6dfd5 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:18.192076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:18.198077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e56b5-a467-4ddb-b14e-a2c397f9d92f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:18.198386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e56b5-a467-4ddb-b14e-a2c397f9d92f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:18.198671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e56b5-a467-4ddb-b14e-a2c397f9d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:18.219914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-808e56b5-a467-4ddb-b14e-a2c397f9d92f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:18.221111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-808e56b5-a467-4ddb-b14e-a2c397f9d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:18.291194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:16:18.455497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba6f7-0afc-4c74-b06f-873b4ae6dfd5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:18.457384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4b0ba6f7-0afc-4c74-b06f-873b4ae6dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:18.538027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ba6f7-0afc-4c74-b06f-873b4ae6dfd5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:18.544065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9b78a-2cd9-4427-90c0-d15f738c0506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:18.544653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9b78a-2cd9-4427-90c0-d15f738c0506 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:18.544934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9b78a-2cd9-4427-90c0-d15f738c0506 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:18.545211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9b78a-2cd9-4427-90c0-d15f738c0506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:18.554373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9b78a-2cd9-4427-90c0-d15f738c0506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:18.556479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9b78a-2cd9-4427-90c0-d15f738c0506 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:18.566426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 768/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:19.876418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05931d-a748-42db-8e01-e2060cf5caa1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:19.877028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05931d-a748-42db-8e01-e2060cf5caa1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:19.877028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05931d-a748-42db-8e01-e2060cf5caa1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:19.878381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:19.883217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69bbcb-d8de-4bb3-a2c3-47ba9418394d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:19.883720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69bbcb-d8de-4bb3-a2c3-47ba9418394d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:19.883922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69bbcb-d8de-4bb3-a2c3-47ba9418394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:19.902960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5c69bbcb-d8de-4bb3-a2c3-47ba9418394d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:19.904216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c69bbcb-d8de-4bb3-a2c3-47ba9418394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:19.912361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:20.078193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05931d-a748-42db-8e01-e2060cf5caa1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:20.093083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05931d-a748-42db-8e01-e2060cf5caa1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:20.098873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ea323-3ccb-4a8d-bbcc-641f51c3cf9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:20.099515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea323-3ccb-4a8d-bbcc-641f51c3cf9b service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:20.099794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea323-3ccb-4a8d-bbcc-641f51c3cf9b service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:20.100067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea323-3ccb-4a8d-bbcc-641f51c3cf9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:20.109509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ea323-3ccb-4a8d-bbcc-641f51c3cf9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:20.111160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ea323-3ccb-4a8d-bbcc-641f51c3cf9b service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:20.120754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 747/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:22.316049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2af99-2723-48b2-bb92-e72e4241e04b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:22.316575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2af99-2723-48b2-bb92-e72e4241e04b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:22.316575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2af99-2723-48b2-bb92-e72e4241e04b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:22.318056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 770/1517] 10.222.0.49 () {54 vars in 960 bytes} [Mon Apr 11 13:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:22.323570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc8e0-1290-47dc-a6b1-b67235882c7c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:22.324017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc8e0-1290-47dc-a6b1-b67235882c7c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:22.324118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc8e0-1290-47dc-a6b1-b67235882c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:22.343108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-153fc8e0-1290-47dc-a6b1-b67235882c7c None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:22.344287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-153fc8e0-1290-47dc-a6b1-b67235882c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:22.353193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 748/1518] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Apr 11 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:22.361037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2af99-2723-48b2-bb92-e72e4241e04b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:22.375815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2af99-2723-48b2-bb92-e72e4241e04b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:22.380859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e55da-32e5-45c9-99c3-fd7146a71904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:22.381508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e55da-32e5-45c9-99c3-fd7146a71904 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:22.381793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e55da-32e5-45c9-99c3-fd7146a71904 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:22.382072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e55da-32e5-45c9-99c3-fd7146a71904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:22.392077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e55da-32e5-45c9-99c3-fd7146a71904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:22.393701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e55da-32e5-45c9-99c3-fd7146a71904 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:22.403806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 771/1519] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:31.850692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665452f5-7350-4390-945e-1ac6a89a8e8b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:31.851263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665452f5-7350-4390-945e-1ac6a89a8e8b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:31.851366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665452f5-7350-4390-945e-1ac6a89a8e8b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:31.853445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 749/1520] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:31.858489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0343-e116-439c-a717-b7f26353fa99 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:31.858909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0343-e116-439c-a717-b7f26353fa99 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:31.859042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0343-e116-439c-a717-b7f26353fa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:31.877568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-659c0343-e116-439c-a717-b7f26353fa99 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:31.878794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-659c0343-e116-439c-a717-b7f26353fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:31.886784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 772/1521] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:32.038435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665452f5-7350-4390-945e-1ac6a89a8e8b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:32.053334 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665452f5-7350-4390-945e-1ac6a89a8e8b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:32.059001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e61ba-f2b8-468c-a5a1-4cff1266d0fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:32.059636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e61ba-f2b8-468c-a5a1-4cff1266d0fd service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:32.059918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e61ba-f2b8-468c-a5a1-4cff1266d0fd service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:32.060196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e61ba-f2b8-468c-a5a1-4cff1266d0fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:32.068259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e61ba-f2b8-468c-a5a1-4cff1266d0fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:32.069829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e61ba-f2b8-468c-a5a1-4cff1266d0fd service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:32.079459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 750/1522] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:33.407381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6527c3-f5ac-4f12-83b1-3babe446e47c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:33.407915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6527c3-f5ac-4f12-83b1-3babe446e47c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:33.407915 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6527c3-f5ac-4f12-83b1-3babe446e47c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:33.409323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 773/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:33.414467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c8c6-ee7b-47f7-9310-5dde20eb2176 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:33.415346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c8c6-ee7b-47f7-9310-5dde20eb2176 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:33.415346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c8c6-ee7b-47f7-9310-5dde20eb2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:33.432925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4be8c8c6-ee7b-47f7-9310-5dde20eb2176 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:33.434243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4be8c8c6-ee7b-47f7-9310-5dde20eb2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:33.442148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 751/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:33.598763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6527c3-f5ac-4f12-83b1-3babe446e47c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:33.614477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6527c3-f5ac-4f12-83b1-3babe446e47c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:33.620888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aed88-311e-49f7-b4c5-eaee2330c81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:33.621598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aed88-311e-49f7-b4c5-eaee2330c81e service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:33.621869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aed88-311e-49f7-b4c5-eaee2330c81e service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:33.622180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aed88-311e-49f7-b4c5-eaee2330c81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:33.630606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aed88-311e-49f7-b4c5-eaee2330c81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:33.632194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aed88-311e-49f7-b4c5-eaee2330c81e service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:33.643732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 774/1525] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:38.201389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c473b1-02fe-4188-ab22-64be109aef3b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:38.201930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c473b1-02fe-4188-ab22-64be109aef3b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:38.202021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c473b1-02fe-4188-ab22-64be109aef3b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:38.203448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 752/1526] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:38.209070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37672-fe25-409a-8766-630c9f989551 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:38.209511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37672-fe25-409a-8766-630c9f989551 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:38.209655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37672-fe25-409a-8766-630c9f989551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:38.229664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-75b37672-fe25-409a-8766-630c9f989551 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:38.230984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-75b37672-fe25-409a-8766-630c9f989551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:38.239743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 775/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:38.278420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c473b1-02fe-4188-ab22-64be109aef3b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:38.280207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-90c473b1-02fe-4188-ab22-64be109aef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:38.338809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c473b1-02fe-4188-ab22-64be109aef3b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:38.342383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58753ff8-c0eb-456d-a355-c7bbf1df2523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:38.343035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58753ff8-c0eb-456d-a355-c7bbf1df2523 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:38.343330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58753ff8-c0eb-456d-a355-c7bbf1df2523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:38.343599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58753ff8-c0eb-456d-a355-c7bbf1df2523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:38.353712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58753ff8-c0eb-456d-a355-c7bbf1df2523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:38.355301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58753ff8-c0eb-456d-a355-c7bbf1df2523 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:38.366029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 753/1528] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:40.801943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422542eb-76f1-4389-a35f-1132ecb5f136 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:40.802589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422542eb-76f1-4389-a35f-1132ecb5f136 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:40.802589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422542eb-76f1-4389-a35f-1132ecb5f136 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:40.803936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 776/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:40.809397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0964334-d4e3-428a-81ac-a7c420fd78f9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:40.809851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0964334-d4e3-428a-81ac-a7c420fd78f9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:40.809943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0964334-d4e3-428a-81ac-a7c420fd78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:40.828331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b0964334-d4e3-428a-81ac-a7c420fd78f9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:40.829516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b0964334-d4e3-428a-81ac-a7c420fd78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:40.838307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 754/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:40.876176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422542eb-76f1-4389-a35f-1132ecb5f136 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:40.886850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422542eb-76f1-4389-a35f-1132ecb5f136 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:40.890620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14b57-74b1-47f2-b445-d130f6ecdd19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:40.891275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14b57-74b1-47f2-b445-d130f6ecdd19 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:40.891554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14b57-74b1-47f2-b445-d130f6ecdd19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:40.891827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14b57-74b1-47f2-b445-d130f6ecdd19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:40.901734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f14b57-74b1-47f2-b445-d130f6ecdd19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:40.903245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f14b57-74b1-47f2-b445-d130f6ecdd19 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:40.913169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 777/1531] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:44.944014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834c0-c591-40b9-9b8c-72751f5b20e0 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:44.944617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834c0-c591-40b9-9b8c-72751f5b20e0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:44.944617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834c0-c591-40b9-9b8c-72751f5b20e0 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:44.946639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 755/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:44.952160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae0fd-4227-4105-8150-12e27e5706c3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:44.952621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae0fd-4227-4105-8150-12e27e5706c3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:44.952808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae0fd-4227-4105-8150-12e27e5706c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:44.970662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-123ae0fd-4227-4105-8150-12e27e5706c3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:44.971884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-123ae0fd-4227-4105-8150-12e27e5706c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:44.979785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 778/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:45.261109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834c0-c591-40b9-9b8c-72751f5b20e0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:45.262803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d07834c0-c591-40b9-9b8c-72751f5b20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:45.319725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834c0-c591-40b9-9b8c-72751f5b20e0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:45.324788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2b7b5-9080-4887-a272-9c5e1e692fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:45.325442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2b7b5-9080-4887-a272-9c5e1e692fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:45.325725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2b7b5-9080-4887-a272-9c5e1e692fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:45.325999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2b7b5-9080-4887-a272-9c5e1e692fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:45.335269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2b7b5-9080-4887-a272-9c5e1e692fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:45.337580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2b7b5-9080-4887-a272-9c5e1e692fa2 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:45.347642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 756/1534] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:16:47.755181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae8f4a-f45f-406c-8381-37416001f53c None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:47.755733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae8f4a-f45f-406c-8381-37416001f53c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:47.755733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae8f4a-f45f-406c-8381-37416001f53c None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:47.757081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 779/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:47.763030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173af78-44d8-438c-a5e0-72c6dbd50851 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:47.763570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173af78-44d8-438c-a5e0-72c6dbd50851 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:47.763570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173af78-44d8-438c-a5e0-72c6dbd50851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:47.781945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c173af78-44d8-438c-a5e0-72c6dbd50851 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:47.783164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c173af78-44d8-438c-a5e0-72c6dbd50851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:47.791806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 757/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:48.064402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831babaa-4e1f-4815-a619-26ea0274c6d9 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:48.064692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831babaa-4e1f-4815-a619-26ea0274c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:48.064964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831babaa-4e1f-4815-a619-26ea0274c6d9 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:48.066412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 780/1537] 10.222.0.49 () {54 vars in 962 bytes} [Mon Apr 11 13:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:16:48.072162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f21e2-1aa1-4511-8318-a303c8c7bed7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:48.072457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f21e2-1aa1-4511-8318-a303c8c7bed7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:48.072752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f21e2-1aa1-4511-8318-a303c8c7bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:48.091440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ff3f21e2-1aa1-4511-8318-a303c8c7bed7 None None] MFA Rules not processed for user `ebd82c17696d4a258748cc70ebc8569a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:16:48.092653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ff3f21e2-1aa1-4511-8318-a303c8c7bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:16:48.099186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 758/1538] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Apr 11 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:16:48.107474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831babaa-4e1f-4815-a619-26ea0274c6d9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:16:48.119405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831babaa-4e1f-4815-a619-26ea0274c6d9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:16:48.123069 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5095-47be-457a-b12b-e830065dceeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:16:48.123714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5095-47be-457a-b12b-e830065dceeb service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:16:48.123997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5095-47be-457a-b12b-e830065dceeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:16:48.124273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5095-47be-457a-b12b-e830065dceeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:16:48.133955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5095-47be-457a-b12b-e830065dceeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:16:48.135544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5095-47be-457a-b12b-e830065dceeb service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:16:48.144882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 781/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:18:26.639522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:26.640134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:26.640134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:26.672597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:26.673878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:26.687863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 759/1540] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:26.698781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:26.699361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:26.699564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:26.729121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:26.731018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:26.751257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 782/1541] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:26.756913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:26.769008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed09ed-6451-4665-9d6e-a482e15de4cd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:26.781217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:26.781919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:26.782236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:26.782523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:26.783428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:26.783738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:26.785389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad702e-7e1d-49a2-81c2-b86e8f2f30ec admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:26.800113 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 760/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:26.808634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:26.819063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9e048-89ce-47c8-80b1-7edeeb3718f2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:26.834150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:26.834863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:26.835146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:26.835427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:26.836161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:26.838223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:26.869770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682de64-b695-45d6-b006-1c95c9ea6079 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:26.871190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682de64-b695-45d6-b006-1c95c9ea6079 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:26.871570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682de64-b695-45d6-b006-1c95c9ea6079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:26.907508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2682de64-b695-45d6-b006-1c95c9ea6079 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:26.908674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2682de64-b695-45d6-b006-1c95c9ea6079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:26.928179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 761/1543] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:26.938798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d412324-155f-45f6-9d6c-1713615b99b9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:26.939133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d412324-155f-45f6-9d6c-1713615b99b9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:26.939363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d412324-155f-45f6-9d6c-1713615b99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:26.954931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 783/1544] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:26.963007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:26.977615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6d412324-155f-45f6-9d6c-1713615b99b9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:26.978872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6d412324-155f-45f6-9d6c-1713615b99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.041616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510817d8-93a9-4a47-827f-b3d4b2801e44 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.062853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.063583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.063871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.064153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.065961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.068137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:18:27.068137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:18:27.068137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:18:27.070332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.098572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 762/1545] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:27.100311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0996c-4c6d-426b-b74a-f8a67345d3da None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.100868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0996c-4c6d-426b-b74a-f8a67345d3da None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.101409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0996c-4c6d-426b-b74a-f8a67345d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.126873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2fa0996c-4c6d-426b-b74a-f8a67345d3da None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.128513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2fa0996c-4c6d-426b-b74a-f8a67345d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.139225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 763/1546] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.141257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3349-5903-4041-86a4-ba2c9cfbdf16 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.141792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3349-5903-4041-86a4-ba2c9cfbdf16 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.142326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3349-5903-4041-86a4-ba2c9cfbdf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.163504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 784/1547] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:26 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:18:27.164699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.165179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2f5f3349-5903-4041-86a4-ba2c9cfbdf16 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.166436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f5f3349-5903-4041-86a4-ba2c9cfbdf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.175621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 764/1548] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.186299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f130a2-7d94-4304-baae-60ca7aa712da admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.186463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5739-79ee-424e-aba0-c4dde85abe31 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.186463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5739-79ee-424e-aba0-c4dde85abe31 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.186463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5739-79ee-424e-aba0-c4dde85abe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.186702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.186702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.186702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.186702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.187024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.187024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.187024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:18:27.187024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:18:27.187024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:18:27.187024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585957d-6913-4d2b-a3fc-799d4d099e18 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.198007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-986a5739-79ee-424e-aba0-c4dde85abe31 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.200265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 785/1549] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.200583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-986a5739-79ee-424e-aba0-c4dde85abe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.203637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab80c0-45cf-4854-bf24-91d65ffc6e72 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.204066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab80c0-45cf-4854-bf24-91d65ffc6e72 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.204606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab80c0-45cf-4854-bf24-91d65ffc6e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.209459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 765/1550] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.210948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb857e-bd33-4ef9-869b-2d5f956b65de None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.211241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb857e-bd33-4ef9-869b-2d5f956b65de None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.211540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb857e-bd33-4ef9-869b-2d5f956b65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.230032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-feab80c0-45cf-4854-bf24-91d65ffc6e72 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.231728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-feab80c0-45cf-4854-bf24-91d65ffc6e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.231861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-82eb857e-bd33-4ef9-869b-2d5f956b65de None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.233041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-82eb857e-bd33-4ef9-869b-2d5f956b65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.240300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 786/1551] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.252174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 766/1552] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.252174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.252174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.252174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.252523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d39709-d8d0-4b82-b4f0-57ac6476fd4f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.252523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d39709-d8d0-4b82-b4f0-57ac6476fd4f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.252523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d39709-d8d0-4b82-b4f0-57ac6476fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.263139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.264399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.270401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-60d39709-d8d0-4b82-b4f0-57ac6476fd4f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.271678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-60d39709-d8d0-4b82-b4f0-57ac6476fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.272942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 767/1553] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.273773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.285311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab400b55-19f7-4b68-a0a6-87c5e65b04c3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.289400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 787/1554] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.290639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.290789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80490-bcba-4fdd-a162-ffb2f094e6e8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.291007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80490-bcba-4fdd-a162-ffb2f094e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.291287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80490-bcba-4fdd-a162-ffb2f094e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.291407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.291570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.291883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.293033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.294583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.306214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 768/1555] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:27.310600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.311413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-84a80490-bcba-4fdd-a162-ffb2f094e6e8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.312654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-84a80490-bcba-4fdd-a162-ffb2f094e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.320795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecde283-841c-4a67-9f37-4868d14872bf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.321366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 788/1556] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.322830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.324211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.324211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.329046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.329745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.330049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.330361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.331064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.332353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:18:27.332353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:18:27.332353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:18:27.334585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1f390-4078-490a-9fae-e1fecd4e711b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.347545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.348844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.357427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 789/1557] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.358297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.369486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e1de1-b422-4fd5-9dc7-a8e58e371e13 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.375026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.375751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.376031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.376311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.377081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.377381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.379031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c36cd-3459-44bd-925b-8ecc375aee5f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.392210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 790/1558] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.397430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878cdb-00cc-4936-89f1-711e8885b9fe None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.397430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878cdb-00cc-4936-89f1-711e8885b9fe None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.397430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878cdb-00cc-4936-89f1-711e8885b9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.412125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ac878cdb-00cc-4936-89f1-711e8885b9fe None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.413318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ac878cdb-00cc-4936-89f1-711e8885b9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.425431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 791/1559] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.425887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.425887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.425887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.445568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.446796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.451224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 769/1560] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:27.454224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.454224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.454224 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.455028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 792/1561] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.455775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.467159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9428a-036e-4c57-9088-e6eedcde67c0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.475943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:27.477205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:27.526937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.527647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.527931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.528204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.529140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.530904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.541184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 793/1562] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:27.542708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.545973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 770/1563] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:27.547004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.563237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cd24c-9b67-479b-9713-75a2e88cebf5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.563429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde62e9-d5fd-42cb-875e-cf661464ad43 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.566324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.566324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.566324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.566324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.567000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.567162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.567422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.567813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.568094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.568373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.569102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.569363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.569480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.573335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.594316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 771/1564] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.594601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 794/1565] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.594755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.594897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.606391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2ef1f-afa0-4f94-a285-087e22f50722 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.606661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413508af-cca7-4e65-b571-4ccd0bd9bca8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.611262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.611408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.612601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.612749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.612843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.612929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.613005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.613098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.613315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.613485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.613686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.615193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.615338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.632356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 795/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.633385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.647812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afd30e-422a-4696-acb2-cc1174495250 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.653283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.654172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.654422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.654717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.655403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.657359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.729051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 772/1567] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:27.730720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.759661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 796/1568] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:27.760834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.771084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def164e1-2571-4b65-9355-736549f581bf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.804704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5608-cab9-40ce-b527-49637786b333 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.812905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.813571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.813850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.814145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.814881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.815185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.817095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.831233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.832141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.832418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.832689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] PATH_INFO: `/v3/projects/70f9bb59f05040b99068fef7330a756a/users/af7e95f4699840629cda1680de65d77f/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.833319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 773/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.834299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.852664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c5712-7cf1-47c0-a9fe-82f29adf6a5a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.856706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9bb59f05040b99068fef7330a756a, user_id=af7e95f4699840629cda1680de65d77f, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.859307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.859461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.859980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.860265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.860540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.861310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:27.861611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.863249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.876085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 774/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:27.876899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:27.886959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4aa94-b599-4ffa-b742-64d45fdb83d9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:27.891647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:27.892317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:27.892593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:27.892869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:27.893595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:27.895549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:27.955027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 797/1571] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:27 2022] PUT /identity/v3/projects/70f9bb59f05040b99068fef7330a756a/users/af7e95f4699840629cda1680de65d77f/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:27.955843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.017531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af15e-a352-46c1-9ab6-a432f2fb23c0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.022466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 775/1572] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.022466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.085266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.085930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.086243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.086674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.087375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.089862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.098563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839fabd-7a05-45fa-819a-aef3792d07c6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.103363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.104063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.105071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.105391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.106099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.108159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.168460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 798/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:27 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.169268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.200235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 776/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.200235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.237197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af069e8-a6bc-4440-adee-ecd02f83f78a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.264445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f205-953a-4849-b11f-a6ee54f088e3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.269210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.271230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.271230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.271230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.271230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.272914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.284169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 777/1575] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:28.285026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.293233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.293918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.294229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.294504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.295197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.295487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b2601-d38f-4b94-9cd8-7004f6ae3ffa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.297116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.300256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f530e74-6a12-4327-8660-64d53b358caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.300932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530e74-6a12-4327-8660-64d53b358caa admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.301309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530e74-6a12-4327-8660-64d53b358caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.301593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530e74-6a12-4327-8660-64d53b358caa admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.302337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f530e74-6a12-4327-8660-64d53b358caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.304321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f530e74-6a12-4327-8660-64d53b358caa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.444586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 799/1576] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.445408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.455684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e47db-0d20-4f89-86d9-7072b34786ae admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.460224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.460865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.461145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.461421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.462125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.464640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.484205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 778/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.484205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.484205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.486625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.502130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:28.503316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:28.563406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 779/1578] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:28.564506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.567335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 800/1579] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.568066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.575188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac967-4885-4c03-8641-58a57141bd31 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.632033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e137eab-fa9c-4b6f-a531-fc13cf655cb2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.637547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.638247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.638443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.638578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.638794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.639141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.639435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.639657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.639784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.640438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.641566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.642370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.766719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 801/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.767582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.778826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494e937-c616-4dcf-8ce8-601c19e7ad7d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.786009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 780/1581] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.786009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.788778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.789734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.790321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.790767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.791618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.794064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb158a5-3afc-49de-bf3d-97d13f4d835c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.794616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.798689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.799395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.799678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.799944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.800846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.802472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.813449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 781/1582] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:28.815366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.825443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57bf93-4efa-4b8f-96a1-546d564dc82b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.831112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.831837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.832153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.832519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.833424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.835272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.847226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 782/1583] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:28.848026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.858385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1120a3e-b8fd-4237-b16d-3f2daca6c56d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.863012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.863681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.863958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.864228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.864911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.866856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.899127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 802/1584] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.901719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:28.917570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc69e6-2f8d-454e-85e9-9767a1a5c65b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:28.922393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:28.923108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:28.923389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:28.923674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:28.924432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:28.926389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:28.991391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 783/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:28.992463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.019211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 803/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:28 2022] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:29.020053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.030502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a47f8-19f8-42b1-83fc-dee39f0b7998 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.037892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.038638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.039003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.039209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.039940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.041519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.051782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c33d-6beb-49b6-b848-6ac951175108 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.052236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 804/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.052876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.058331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.058990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.059271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.059548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.062131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e791-d8be-43a3-b42e-dc48e19ba632 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.066832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.067481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.067765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.068063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.068807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.069974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.070427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.071540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.085718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 784/1588] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:29.085945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 805/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.086058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.086191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.096605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a413560-8ff0-46de-8d10-8ea38fa1ec5a service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.098974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a92af1-98e0-4496-ba0c-22855b4eafa7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.102328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.102493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.103053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.103053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] PATH_INFO: `/v3/projects/6198c26cda334183a887981e3e0b0a57/users/7de32941f95643a5870dfe78ab217504/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.107064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.108192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.108692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.109193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.110753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.113522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.119950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6198c26cda334183a887981e3e0b0a57, user_id=7de32941f95643a5870dfe78ab217504, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.122874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:18:29.122874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:18:29.122874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:18:29.125154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.130762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 806/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.131632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.143952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4c7c-6b7a-48a4-9a93-baa17cebaa28 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.148692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.149489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.149731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.150008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.154385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.154385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.163470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 807/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.164302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.178347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203343f8-122c-4afc-a45a-ebe9d3ca6606 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.187086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.187086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.187086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.187086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.187579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.187579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.197793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 808/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.199496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.209866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7860dc-f304-48d8-a38f-424b08b94df3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.212745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 785/1593] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:29 2022] PUT /identity/v3/projects/6198c26cda334183a887981e3e0b0a57/users/7de32941f95643a5870dfe78ab217504/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:29.212745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.298465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.299353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.299775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.300157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.301121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.303242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.311727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b9b76-2678-4278-8849-7371d4f9c443 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.317302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 809/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.318250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.321326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.322152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.322505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.323873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.325082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.326978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.330068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e3da-4200-435b-8c86-f169e47956c0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.337125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.338071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.338389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 786/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.338552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.338552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.339303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.339400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.340916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.351441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706789d-671a-4590-a59f-639fae08f399 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.352012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 810/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.353009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.359399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.360311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.360722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.360998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] PATH_INFO: `/v3/projects/76db52af4527447e89bdb818b0408a55/users/d2f8cdceb682478a88228b850e91fc1e/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.363387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff3ffe-950d-463d-8cb1-d31b5f625101 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.368302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.376767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.376767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.376767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.376767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.376767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.378626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76db52af4527447e89bdb818b0408a55, user_id=d2f8cdceb682478a88228b850e91fc1e, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.381299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.385064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 811/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.387321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.406670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2c8bd-4a41-446c-9d7e-79c2578fe931 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.414406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd96ef-0293-4630-9d2f-26ccbe70780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.415538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd96ef-0293-4630-9d2f-26ccbe70780a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.415856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd96ef-0293-4630-9d2f-26ccbe70780a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.416114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd96ef-0293-4630-9d2f-26ccbe70780a admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.416884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd96ef-0293-4630-9d2f-26ccbe70780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.418658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd96ef-0293-4630-9d2f-26ccbe70780a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.429074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 812/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.430606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.430897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.431172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.461105 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] MFA Rules not processed for user `7de32941f95643a5870dfe78ab217504`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:29.462352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:29.482156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 787/1599] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:29 2022] PUT /identity/v3/projects/76db52af4527447e89bdb818b0408a55/users/d2f8cdceb682478a88228b850e91fc1e/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:29.482156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.570664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430155-915b-4739-86e3-83a76bdf5858 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.577849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.578673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.579055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.579407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.580234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.582098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.587530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 813/1600] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:29.593485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.598069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 788/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:29.598069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.606532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc2014-fcf6-4874-825f-e9b5bf26e28d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.608927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0c13-fe40-4945-a3eb-cb3e9b054b07 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.611375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.612337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.612699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.612985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] PATH_INFO: `/v3/projects/c567d5d203c8413189811e292ad89149/users/d04b409660b249e3bd162a730224b8df/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.614826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.615811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.616302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.616594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] PATH_INFO: `/v3/projects/cc58e300bfaa41acabc1a63ae6861fe9/users/8dbb7a53bcfc4cda80b8922c216b5964/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.631524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c567d5d203c8413189811e292ad89149, user_id=d04b409660b249e3bd162a730224b8df, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.634325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.636222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc58e300bfaa41acabc1a63ae6861fe9, user_id=8dbb7a53bcfc4cda80b8922c216b5964, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.640059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.716560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 814/1602] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:29 2022] PUT /identity/v3/projects/c567d5d203c8413189811e292ad89149/users/d04b409660b249e3bd162a730224b8df/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:29.727734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.749444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 789/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:29 2022] PUT /identity/v3/projects/cc58e300bfaa41acabc1a63ae6861fe9/users/8dbb7a53bcfc4cda80b8922c216b5964/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:29.750612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:29.812541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b248f8-9ea4-40ac-a8aa-0f15bb5cfcc5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.828931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a5b1b-2293-40c1-a69c-f18264a8e46f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:29.836458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.842051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.842051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.842051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] PATH_INFO: `/v3/projects/6da835078df84f0ab2e0221f23a79b65/users/1645581d13c54204a0f32a67738fd2a0/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.874006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da835078df84f0ab2e0221f23a79b65, user_id=1645581d13c54204a0f32a67738fd2a0, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.877882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.891435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017817c-1862-4a3f-9627-39d4ab063826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:29.892470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017817c-1862-4a3f-9627-39d4ab063826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.892809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017817c-1862-4a3f-9627-39d4ab063826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.896032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017817c-1862-4a3f-9627-39d4ab063826 admin admin] PATH_INFO: `/v3/projects/8ca6068922ae4790be47d18b5dd8966f/users/671a148c737740829e1959770dd5bd14/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.911473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017817c-1862-4a3f-9627-39d4ab063826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca6068922ae4790be47d18b5dd8966f, user_id=671a148c737740829e1959770dd5bd14, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:29.914097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017817c-1862-4a3f-9627-39d4ab063826 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:29.997009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 815/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:29 2022] PUT /identity/v3/projects/8ca6068922ae4790be47d18b5dd8966f/users/671a148c737740829e1959770dd5bd14/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:29.997009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:29.997009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:29.997537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 790/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:29 2022] PUT /identity/v3/projects/6da835078df84f0ab2e0221f23a79b65/users/1645581d13c54204a0f32a67738fd2a0/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:29.997683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:29.997829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.032739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] MFA Rules not processed for user `d2f8cdceb682478a88228b850e91fc1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.034522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.071722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7aece-cc5d-45ac-b5c2-e4ffed0de818 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.077545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483d851-8ee6-4eee-b66c-e12bea6f39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.078256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483d851-8ee6-4eee-b66c-e12bea6f39bb admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.078602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483d851-8ee6-4eee-b66c-e12bea6f39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.078921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483d851-8ee6-4eee-b66c-e12bea6f39bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.079842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483d851-8ee6-4eee-b66c-e12bea6f39bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.081638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483d851-8ee6-4eee-b66c-e12bea6f39bb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.116831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 816/1606] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.118019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.131854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e767a3-08a0-4c1b-9766-f0f0f5be5744 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.138365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f56039-3edf-4f38-92be-7dd3860e1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.139583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f56039-3edf-4f38-92be-7dd3860e1eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.139868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f56039-3edf-4f38-92be-7dd3860e1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.140146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f56039-3edf-4f38-92be-7dd3860e1eea admin admin] PATH_INFO: `/v3/projects/7a501243b9c1481fbf2c5a0498b3c275/users/06f290ec2cba4a658ff44752ea49a247/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.156673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f56039-3edf-4f38-92be-7dd3860e1eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a501243b9c1481fbf2c5a0498b3c275, user_id=06f290ec2cba4a658ff44752ea49a247, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.159402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f56039-3edf-4f38-92be-7dd3860e1eea admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.204034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 791/1607] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:29 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:30.205359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41526-7b89-41f6-aa43-1a386eb39860 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.205647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41526-7b89-41f6-aa43-1a386eb39860 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.205926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41526-7b89-41f6-aa43-1a386eb39860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.237050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2be41526-7b89-41f6-aa43-1a386eb39860 None None] MFA Rules not processed for user `d04b409660b249e3bd162a730224b8df`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.238298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2be41526-7b89-41f6-aa43-1a386eb39860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.323532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 792/1608] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.323532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9145b-2700-4575-9c8d-488f591730ac None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.323532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9145b-2700-4575-9c8d-488f591730ac None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.323532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9145b-2700-4575-9c8d-488f591730ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.328695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 817/1609] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:30 2022] PUT /identity/v3/projects/7a501243b9c1481fbf2c5a0498b3c275/users/06f290ec2cba4a658ff44752ea49a247/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:30.331147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66e156-8353-4984-b7b6-96168fd31be8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.331624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66e156-8353-4984-b7b6-96168fd31be8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.332149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66e156-8353-4984-b7b6-96168fd31be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.347954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3bf9145b-2700-4575-9c8d-488f591730ac None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.349197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3bf9145b-2700-4575-9c8d-488f591730ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.352811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bc66e156-8353-4984-b7b6-96168fd31be8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.353994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bc66e156-8353-4984-b7b6-96168fd31be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.412703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 793/1610] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.414145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1fec5-17a8-4cfb-9b83-655aba6d10b1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.414424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1fec5-17a8-4cfb-9b83-655aba6d10b1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.414717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1fec5-17a8-4cfb-9b83-655aba6d10b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.422976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 818/1611] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.424365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72f78-af4d-41cc-b661-cae43a1f6309 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.424647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72f78-af4d-41cc-b661-cae43a1f6309 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.424938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72f78-af4d-41cc-b661-cae43a1f6309 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.426626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 819/1612] 10.222.0.49 () {54 vars in 960 bytes} [Mon Apr 11 13:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:30.431922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72f78-af4d-41cc-b661-cae43a1f6309 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.450763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d0c1fec5-17a8-4cfb-9b83-655aba6d10b1 None None] MFA Rules not processed for user `671a148c737740829e1959770dd5bd14`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.451133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72f78-af4d-41cc-b661-cae43a1f6309 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.451984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d0c1fec5-17a8-4cfb-9b83-655aba6d10b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.455703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f88ce-ae94-435f-b340-313aef5ad4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.458470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f88ce-ae94-435f-b340-313aef5ad4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.458470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f88ce-ae94-435f-b340-313aef5ad4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.458470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f88ce-ae94-435f-b340-313aef5ad4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.458470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f88ce-ae94-435f-b340-313aef5ad4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.459760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f88ce-ae94-435f-b340-313aef5ad4d5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.529084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 794/1613] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.530528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fad08-3689-4e8b-9e20-959187da683e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.530811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fad08-3689-4e8b-9e20-959187da683e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.531083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fad08-3689-4e8b-9e20-959187da683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.545247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 820/1614] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/users => generated 308 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:30.546786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014f88e-30e5-4e05-a5b7-0a060784442b None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.547117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014f88e-30e5-4e05-a5b7-0a060784442b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.547397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014f88e-30e5-4e05-a5b7-0a060784442b None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.549014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 821/1615] 10.222.0.49 () {54 vars in 960 bytes} [Mon Apr 11 13:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:30.549663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014f88e-30e5-4e05-a5b7-0a060784442b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.561521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6f5fad08-3689-4e8b-9e20-959187da683e None None] MFA Rules not processed for user `06f290ec2cba4a658ff44752ea49a247`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.563415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6f5fad08-3689-4e8b-9e20-959187da683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.616557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014f88e-30e5-4e05-a5b7-0a060784442b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.621455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.622278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.622567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.622846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.632627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.634173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.640406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 795/1616] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.640406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.640406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.640406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.647388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 822/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:30.651200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.654039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.665444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.667057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90400cb-ede1-4559-8c54-a8c693fb9636 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.673035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.673179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.673179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.673179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.673179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.683122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.684671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.695210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 823/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:30.695800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.707202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880925d5-9e8b-4110-a865-d6c8ae854359 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.712895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.714252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.714700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.715312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.716112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.718328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.758622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 796/1619] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.759577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.772800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d7b1-3817-491a-924d-793a04415d9f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.776453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0c732-6267-499b-bab7-4293ee99a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.777323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c732-6267-499b-bab7-4293ee99a4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.777617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c732-6267-499b-bab7-4293ee99a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.778546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0c732-6267-499b-bab7-4293ee99a4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.779287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c732-6267-499b-bab7-4293ee99a4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:30.780917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0c732-6267-499b-bab7-4293ee99a4fa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:30.795480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 797/1620] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:30.797682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.798175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.798453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.827158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:30.828467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:30.844087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 824/1621] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:30.844685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 798/1622] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:30.844685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.852039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:30.866581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f083bc-593c-4b0b-b16c-82a1efe8f3a1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:30.960964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:30.962099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:30.962417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:30.962783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:30.996422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb46c-ffaf-4b26-b1bb-7e3fc303e756 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.004826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.006136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.006731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.007692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.008872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.013200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.052705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.055190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.068251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 799/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:31.069549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.098644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88652d44-76be-4b54-b769-46d616611b4a service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.098644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.098644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.098644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.102033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] PATH_INFO: `/v3/projects/9363e83c2a8949c6ba11dfedf7b3ffe0/users/5d16daf7b4ad4d3dbc2354b9896a3c8a/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.141993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9363e83c2a8949c6ba11dfedf7b3ffe0, user_id=5d16daf7b4ad4d3dbc2354b9896a3c8a, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.144843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.150082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 825/1624] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:30 2022] POST /identity/v3/projects => generated 401 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:31.154941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.257437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee481f0-71cd-4fc4-b50e-6f01d1ad9352 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.266422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.267551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.268135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.268562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.269539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.272106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.307218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 800/1625] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:31 2022] PUT /identity/v3/projects/9363e83c2a8949c6ba11dfedf7b3ffe0/users/5d16daf7b4ad4d3dbc2354b9896a3c8a/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:31.309066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.428623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 826/1626] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:31 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:31.437901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.441447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62988530-fed1-49ad-a69e-825d073a07bf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.449610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f00dfc-baad-454b-8f95-359a644a3578 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.456811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.458265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.458554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.460853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.561487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.562228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.562670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.562955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.563660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.565654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.602997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.607138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.621460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 801/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:31.622672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.635840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe485912-598f-4b90-84bd-813c879d378d service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.643677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b16e5-4d71-4220-a304-1f19a368e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.644597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b16e5-4d71-4220-a304-1f19a368e222 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.644932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b16e5-4d71-4220-a304-1f19a368e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.650055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b16e5-4d71-4220-a304-1f19a368e222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.650055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b16e5-4d71-4220-a304-1f19a368e222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.650055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b16e5-4d71-4220-a304-1f19a368e222 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.667757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 802/1628] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:31.667757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c9217-b4da-489f-9802-eff98826ddca None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.667757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c9217-b4da-489f-9802-eff98826ddca None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.668861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c9217-b4da-489f-9802-eff98826ddca None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.671732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 803/1629] 10.222.0.49 () {54 vars in 912 bytes} [Mon Apr 11 13:18:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:31.677183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c9217-b4da-489f-9802-eff98826ddca None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.689634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 827/1630] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:31 2022] POST /identity/v3/users => generated 307 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:31.689634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.696710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c9217-b4da-489f-9802-eff98826ddca None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.702325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a02f0d-8f15-4cda-8325-a07a2b83e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.703094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a02f0d-8f15-4cda-8325-a07a2b83e1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.703431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a02f0d-8f15-4cda-8325-a07a2b83e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.703716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a02f0d-8f15-4cda-8325-a07a2b83e1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.704352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1938bc-3d1e-4cb7-8960-63ae2e919928 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.704646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a02f0d-8f15-4cda-8325-a07a2b83e1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.706750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a02f0d-8f15-4cda-8325-a07a2b83e1dd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.710482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.711610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.712358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.718875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] PATH_INFO: `/v3/projects/9363e83c2a8949c6ba11dfedf7b3ffe0/users/5d16daf7b4ad4d3dbc2354b9896a3c8a/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.718875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9363e83c2a8949c6ba11dfedf7b3ffe0, user_id=5d16daf7b4ad4d3dbc2354b9896a3c8a, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.720052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.720670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 804/1631] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:31.722316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c0d2-a794-4144-b555-de5255c58358 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.722615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c0d2-a794-4144-b555-de5255c58358 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.722897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c0d2-a794-4144-b555-de5255c58358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.748421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 828/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:31 2022] PUT /identity/v3/projects/9363e83c2a8949c6ba11dfedf7b3ffe0/users/5d16daf7b4ad4d3dbc2354b9896a3c8a/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:31.753310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.759324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ef99c0d2-a794-4144-b555-de5255c58358 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:31.761317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ef99c0d2-a794-4144-b555-de5255c58358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:31.844194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ac112-0815-4041-8906-f2390bad3288 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.849946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.856603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.856603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.856603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.856603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.856603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.871090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 829/1633] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:31.871090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:31.892129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46a23-092b-42b5-8767-d292262bd73c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:31.906226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:31.907147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.907448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.907689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] PATH_INFO: `/v3/projects/01ec78f4dda24b8ea584b7118571428f/users/6e667671efc448349a01ec56fbd61825/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:31.952867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ec78f4dda24b8ea584b7118571428f, user_id=6e667671efc448349a01ec56fbd61825, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:31.955723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:31.988509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 805/1634] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:31.993716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b21d-701b-4af6-8b95-e078139e86d0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:31.994362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b21d-701b-4af6-8b95-e078139e86d0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:31.994901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b21d-701b-4af6-8b95-e078139e86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.051415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f154b21d-701b-4af6-8b95-e078139e86d0 None None] MFA Rules not processed for user `5d16daf7b4ad4d3dbc2354b9896a3c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:32.053448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f154b21d-701b-4af6-8b95-e078139e86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:32.088510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 830/1635] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:31 2022] PUT /identity/v3/projects/01ec78f4dda24b8ea584b7118571428f/users/6e667671efc448349a01ec56fbd61825/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:32.090840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.194696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 806/1636] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:32.196255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1359874-cdeb-419f-a693-a70dea38146f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.196493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1359874-cdeb-419f-a693-a70dea38146f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.196775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1359874-cdeb-419f-a693-a70dea38146f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.199006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 807/1637] 10.222.0.49 () {54 vars in 912 bytes} [Mon Apr 11 13:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:32.199616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1359874-cdeb-419f-a693-a70dea38146f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.268444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855634fc-7c19-4781-9a2c-7c5657ea6188 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.273753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.274929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.275180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.275667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] PATH_INFO: `/v3/projects/0691a508dfe24d1eb0e2ba65a07eece3/users/3d23f8ed4a6446b19547878658ca7c01/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.305675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0691a508dfe24d1eb0e2ba65a07eece3, user_id=3d23f8ed4a6446b19547878658ca7c01, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.311132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.363284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1359874-cdeb-419f-a693-a70dea38146f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.371176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.371176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.371176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.371176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.424595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 831/1638] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:32 2022] PUT /identity/v3/projects/0691a508dfe24d1eb0e2ba65a07eece3/users/3d23f8ed4a6446b19547878658ca7c01/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:32.425438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.504266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.520389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.520389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 808/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:32.520389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.528486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce36e5-b05f-4175-a270-90e9ed2428a0 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.535255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24113-6908-4769-80ab-05b59a909f57 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.540485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fd30b-0376-431f-8154-a0db38f87ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.542855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd30b-0376-431f-8154-a0db38f87ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.542855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd30b-0376-431f-8154-a0db38f87ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.542855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd30b-0376-431f-8154-a0db38f87ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.542855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fd30b-0376-431f-8154-a0db38f87ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.544629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fd30b-0376-431f-8154-a0db38f87ba8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.556769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 832/1640] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:32.558825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.559216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.559503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.590237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:32.591462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:32.614014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.615102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.615596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.616716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.727379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 833/1641] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:32.728320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.741687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a084d-e141-486b-ad54-5c251b3799d9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.747512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.748238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.748494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.748984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.749713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.750062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.751427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.754462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.765571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 834/1642] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:32.765571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.785567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 809/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:32.786685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:32.789650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0d276-7b5a-4873-9754-4ec3a22a1afc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.804226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3b998-b823-4b5f-8189-0b557eb03e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.805289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b998-b823-4b5f-8189-0b557eb03e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.805564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b998-b823-4b5f-8189-0b557eb03e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.805834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b998-b823-4b5f-8189-0b557eb03e16 admin admin] PATH_INFO: `/v3/projects/01ec78f4dda24b8ea584b7118571428f/users/6e667671efc448349a01ec56fbd61825/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.808679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e1b1-9c14-4a24-9dc6-d9d8c7109424 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:32.810868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3b998-b823-4b5f-8189-0b557eb03e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ec78f4dda24b8ea584b7118571428f, user_id=6e667671efc448349a01ec56fbd61825, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.813589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3b998-b823-4b5f-8189-0b557eb03e16 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.822567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f640-c768-41bc-b550-cfdf4e75a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:32.824122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f640-c768-41bc-b550-cfdf4e75a2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.824406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f640-c768-41bc-b550-cfdf4e75a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.824681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f640-c768-41bc-b550-cfdf4e75a2cd admin admin] PATH_INFO: `/v3/projects/0691a508dfe24d1eb0e2ba65a07eece3/users/3d23f8ed4a6446b19547878658ca7c01/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.833954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f640-c768-41bc-b550-cfdf4e75a2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0691a508dfe24d1eb0e2ba65a07eece3, user_id=3d23f8ed4a6446b19547878658ca7c01, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:32.839416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f640-c768-41bc-b550-cfdf4e75a2cd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:32.857037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 835/1644] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:32 2022] PUT /identity/v3/projects/01ec78f4dda24b8ea584b7118571428f/users/6e667671efc448349a01ec56fbd61825/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:32.861836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.862169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.862440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.881423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 810/1645] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:32 2022] PUT /identity/v3/projects/0691a508dfe24d1eb0e2ba65a07eece3/users/3d23f8ed4a6446b19547878658ca7c01/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:32.905209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f554d-c985-4fb5-a51e-bd03e053fb6a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:32.906801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f554d-c985-4fb5-a51e-bd03e053fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:32.906801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f554d-c985-4fb5-a51e-bd03e053fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:32.926239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] MFA Rules not processed for user `6e667671efc448349a01ec56fbd61825`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:32.927465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:33.068943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-991f554d-c985-4fb5-a51e-bd03e053fb6a None None] MFA Rules not processed for user `3d23f8ed4a6446b19547878658ca7c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:33.070297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-991f554d-c985-4fb5-a51e-bd03e053fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:33.092621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 836/1646] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:33.093945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:33.233654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a950f4-88fe-465f-8ae9-e8b243e13f35 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:33.239797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 811/1647] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:33.250564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a019c-f93f-41a4-9bd0-a9f3f252974c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:33.251733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a019c-f93f-41a4-9bd0-a9f3f252974c service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:33.252256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a019c-f93f-41a4-9bd0-a9f3f252974c service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:33.252766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a019c-f93f-41a4-9bd0-a9f3f252974c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:33.436147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a019c-f93f-41a4-9bd0-a9f3f252974c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:33.438684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a019c-f93f-41a4-9bd0-a9f3f252974c service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:33.460053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 837/1648] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:33.909925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:33.910207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:33.910530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:33.960269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] MFA Rules not processed for user `8dbb7a53bcfc4cda80b8922c216b5964`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:33.961566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:34.041344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 812/1649] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:34.056035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:34.056035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:34.056035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:34.076471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] MFA Rules not processed for user `8dbb7a53bcfc4cda80b8922c216b5964`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:34.078205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:34.085951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 838/1650] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:34.398702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:34.412387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef38a3-3960-4731-b0cb-5016a53f2114 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:34.421764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:34.422854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:34.425063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:34.425591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:34.449800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:34.454451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:34.470540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:34.486162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b148d-198d-4fbf-a441-bd522daa7776 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:34.499084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 813/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:34.513444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:34.516983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:34.517448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:34.517875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:34.543886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:34.549711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:34.566124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 839/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:18:34.729038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:34.754972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a12df-2873-43be-a117-da74c3238920 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:34.774150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:34.775058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:34.775503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:34.776848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:34.797730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:34.806002 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:34.829579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 814/1653] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:34.989678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:35.123437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ff76-da52-49aa-a3e3-2ad20deefef1 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:35.129924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:35.130856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.131329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.131815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] PATH_INFO: `/v3/users/7de32941f95643a5870dfe78ab217504` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.133705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de32941f95643a5870dfe78ab217504)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:35.137318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:35.156174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:35.167176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad2b32-285a-47e9-aa4d-6cd317f7a9a6 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:35.176689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:35.176689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.176689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.176689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.270245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:35.272008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:35.282775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 815/1654] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:35.283884 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:35.297081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2a847-b11c-4c56-8186-5b32ea19e8d1 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:35.302266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2beb10-e7ef-4432-b811-9ed96504d1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:35.303065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2beb10-e7ef-4432-b811-9ed96504d1cf service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.303517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2beb10-e7ef-4432-b811-9ed96504d1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.304712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2beb10-e7ef-4432-b811-9ed96504d1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.438960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2beb10-e7ef-4432-b811-9ed96504d1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:35.443409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2beb10-e7ef-4432-b811-9ed96504d1cf service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:35.465715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de32941f95643a5870dfe78ab217504'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:35.475020 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 816/1655] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:35.559564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b590cb-ae4b-4914-8e57-a891978398f9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.560216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b590cb-ae4b-4914-8e57-a891978398f9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.560710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b590cb-ae4b-4914-8e57-a891978398f9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.562878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 817/1656] 10.222.0.49 () {54 vars in 912 bytes} [Mon Apr 11 13:18:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:35.568630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.569200 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.569660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.580595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de32941f95643a5870dfe78ab217504'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:35.594072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de32941f95643a5870dfe78ab217504'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:35.636686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de32941f95643a5870dfe78ab217504'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:35.640449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b0ba03c7-6ccd-499f-8c57-c339c392b0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de32941f95643a5870dfe78ab217504'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:35.660851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 840/1657] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:34 2022] DELETE /identity/v3/users/7de32941f95643a5870dfe78ab217504 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:35.666245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.666451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.666765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.693602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:35.697708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:35.703483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:35.704817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:35.783382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 841/1658] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:35.836703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:35.838181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:35.858492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 818/1659] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:35.915350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:35.917322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:35.972424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e295b-f04d-425f-a552-78e3a8e73e45 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:35.981634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:35.986617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:35.986617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:35.986617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:35.990123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0800ef4-a318-4d7f-9047-e08ad579485f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:36.007837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:36.009746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:36.030633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2999-a364-41fa-9cc1-d1a6d598deed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:36.034348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 842/1660] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:36.034560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2999-a364-41fa-9cc1-d1a6d598deed service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:36.035593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2999-a364-41fa-9cc1-d1a6d598deed service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:36.035888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2999-a364-41fa-9cc1-d1a6d598deed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:36.071151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2999-a364-41fa-9cc1-d1a6d598deed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:36.072630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef2999-a364-41fa-9cc1-d1a6d598deed service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:36.114934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 819/1661] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:18:37.616172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:37.617688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:37.643784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619e644-3b26-4991-bb81-d0567b17a389 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:37.705831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:37.724585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:37.725146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:37.727600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] PATH_INFO: `/v3/projects/6198c26cda334183a887981e3e0b0a57` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:37.728417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6198c26cda334183a887981e3e0b0a57)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:37.738446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: WARNING py.warnings [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:18:37.738446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: warnings.warn(msg) Apr 11 13:18:37.738446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: Apr 11 13:18:37.740209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:37.994152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6198c26cda334183a887981e3e0b0a57', 'request_id': 'req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:38.009435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6198c26cda334183a887981e3e0b0a57', 'request_id': 'req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:38.092133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ea61-8e77-4441-ab41-c040dc38bb01 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:38.092617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ea61-8e77-4441-ab41-c040dc38bb01 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:38.092719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ea61-8e77-4441-ab41-c040dc38bb01 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:38.094203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 820/1662] 10.222.0.49 () {54 vars in 960 bytes} [Mon Apr 11 13:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:38.105709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:38.106061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:38.108383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:38.137197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6198c26cda334183a887981e3e0b0a57', 'request_id': 'req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:38.160157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] MFA Rules not processed for user `e5fb9818914042078c9fe53bfa51e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:38.162434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:38.228094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] The token cache is being invalidate because project 6198c26cda334183a887981e3e0b0a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:38.228751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:38.233301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:38.245512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 843/1663] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:37 2022] DELETE /identity/v3/projects/6198c26cda334183a887981e3e0b0a57 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:38.252378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:38.260281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:38.377925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 821/1664] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Apr 11 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:38.390883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:38.425678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3fec-9e64-4deb-a0f0-ecaeb119ac0f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:38.440695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:38.441708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:38.442376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:38.444022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:38.448117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:38.475485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:38.478499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271993f-19b8-4ab4-9573-a0fa245a35de service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:38.492949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7e23-4564-4d34-a6ed-6a49ed1c84c2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:38.499467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 822/1665] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:38.514708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:38.515866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:38.517673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:38.518177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] PATH_INFO: `/v3/users/5d16daf7b4ad4d3dbc2354b9896a3c8a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:38.521744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d16daf7b4ad4d3dbc2354b9896a3c8a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:38.525333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:38.904354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d16daf7b4ad4d3dbc2354b9896a3c8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:39.013442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d16daf7b4ad4d3dbc2354b9896a3c8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:39.029973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d16daf7b4ad4d3dbc2354b9896a3c8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:39.069058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d16daf7b4ad4d3dbc2354b9896a3c8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:39.071457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d16daf7b4ad4d3dbc2354b9896a3c8a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:39.089518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 844/1666] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:38 2022] DELETE /identity/v3/users/5d16daf7b4ad4d3dbc2354b9896a3c8a => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:39.284843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:39.285382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:39.285382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:39.339959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] MFA Rules not processed for user `af7e95f4699840629cda1680de65d77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:39.344562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:39.496001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 823/1667] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:39.508740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:39.510360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:39.610520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65e0f-a7bb-4a3c-9747-ecb7678cafb2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:39.617109 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcde661-1738-4629-8266-93ad7c828830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:39.618036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcde661-1738-4629-8266-93ad7c828830 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:39.618525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcde661-1738-4629-8266-93ad7c828830 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:39.619111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcde661-1738-4629-8266-93ad7c828830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:39.633905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcde661-1738-4629-8266-93ad7c828830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:39.636044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcde661-1738-4629-8266-93ad7c828830 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:39.649082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 845/1668] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:18:40.719111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:40.721289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:40.969886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86a2d6-c6d5-4ac8-977d-fb10d760eb93 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:40.976389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:40.978203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:40.983683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:40.983683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] PATH_INFO: `/v3/projects/9363e83c2a8949c6ba11dfedf7b3ffe0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:40.983683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9363e83c2a8949c6ba11dfedf7b3ffe0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:40.983683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:41.203072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9363e83c2a8949c6ba11dfedf7b3ffe0', 'request_id': 'req-604f393f-ceca-4ffa-9972-3fc16e9768c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:41.215294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9363e83c2a8949c6ba11dfedf7b3ffe0', 'request_id': 'req-604f393f-ceca-4ffa-9972-3fc16e9768c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:41.349656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9363e83c2a8949c6ba11dfedf7b3ffe0', 'request_id': 'req-604f393f-ceca-4ffa-9972-3fc16e9768c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:41.391001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] The token cache is being invalidate because project 9363e83c2a8949c6ba11dfedf7b3ffe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:41.391187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:41.398154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:41.407778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 824/1669] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:40 2022] DELETE /identity/v3/projects/9363e83c2a8949c6ba11dfedf7b3ffe0 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:41.420871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3825-7b5b-4a2a-b88c-b12379a32457 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:41.421493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3825-7b5b-4a2a-b88c-b12379a32457 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:41.421591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3825-7b5b-4a2a-b88c-b12379a32457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:41.473640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a1cc3825-7b5b-4a2a-b88c-b12379a32457 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:41.476849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a1cc3825-7b5b-4a2a-b88c-b12379a32457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:41.587779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:41.590777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:41.631227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 846/1670] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:41.647300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:41.647880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:41.648635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:41.678353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:41.680265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:41.693683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 847/1671] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:41.701333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:41.724157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c0b6d-3da5-49d1-a8b4-5bc5d754b75c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:41.734451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:41.736063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:41.736725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:41.737584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:41.741533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f393f-ceca-4ffa-9972-3fc16e9768c7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:41.751594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:41.752060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:41.754864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:41.761672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:41.774328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:41.775498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:41.776476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] PATH_INFO: `/v3/users/d04b409660b249e3bd162a730224b8df` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:41.779041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04b409660b249e3bd162a730224b8df)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:41.781208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: WARNING py.warnings [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:18:41.781208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: warnings.warn(msg) Apr 11 13:18:41.781208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: Apr 11 13:18:41.789416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:41.821914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 848/1672] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:18:41.827891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:41.853295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba762f6-30b0-4eb3-9123-abed6fdbe279 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:41.866256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:41.868272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:41.868678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:41.869029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:41.871853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:41.879894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:42.098664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 849/1673] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:41 2022] POST /identity/v3/projects => generated 403 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:18:42.103778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:42.167035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04b409660b249e3bd162a730224b8df'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:42.170003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04b409660b249e3bd162a730224b8df'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:42.222188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04b409660b249e3bd162a730224b8df'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:42.281262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04b409660b249e3bd162a730224b8df'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:42.281641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d516c292-1046-4d5d-ae19-8d70853ebaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04b409660b249e3bd162a730224b8df'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:42.320830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006fca5-b4f2-4374-a183-9a3a33a0b856 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:42.330877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:42.331758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:42.332200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:42.332577 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:42.333809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:42.339332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:42.381743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 825/1674] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:41 2022] DELETE /identity/v3/users/d04b409660b249e3bd162a730224b8df => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:18:42.383987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:42.384198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:42.384579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:42.429869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:42.431615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:42.514617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 850/1675] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:42 2022] POST /identity/v3/users => generated 302 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:42.515619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:42.520763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:42.592748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9cb3a-d11f-42ba-89f0-87e34aaf158d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:42.715249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 826/1676] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:42.756540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:42.758343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:42.821117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:42.823377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:42.824250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:42.829093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:42.830075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:42.832056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:42.905416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 851/1677] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:18:42.906816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:42.929158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146adbcf-222d-4268-8dac-c6e509cc5696 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:42.947477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749b047-4f9e-4e47-b4f6-06deacfc0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:42.950926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b047-4f9e-4e47-b4f6-06deacfc0735 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:42.950926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b047-4f9e-4e47-b4f6-06deacfc0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:42.950926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b047-4f9e-4e47-b4f6-06deacfc0735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:42.950926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b047-4f9e-4e47-b4f6-06deacfc0735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:42.951411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b047-4f9e-4e47-b4f6-06deacfc0735 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:42.960146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609587cc-0c04-4c4c-bcc0-2fc6678ccf45 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:42.984479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:42.985318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:42.985707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:42.986205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:42.991547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 852/1678] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:42.992925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956a37-38c6-4582-a048-9166d95e463d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:42.993214 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956a37-38c6-4582-a048-9166d95e463d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:42.993488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03956a37-38c6-4582-a048-9166d95e463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.004368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:43.012861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:43.040374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 827/1679] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:18:43.041924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:43.056164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c81d0-59b4-4171-a83b-8b16b678c6f4 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:43.072120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:43.074231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:43.074795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:43.075810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] PATH_INFO: `/v3/projects/7ab1466b824e479b9d7957141177d259/users/b8bd6c5917ac4d068a1629e320098fa6/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.092329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-03956a37-38c6-4582-a048-9166d95e463d None None] MFA Rules not processed for user `1645581d13c54204a0f32a67738fd2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:43.093591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-03956a37-38c6-4582-a048-9166d95e463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:43.111710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab1466b824e479b9d7957141177d259, user_id=b8bd6c5917ac4d068a1629e320098fa6, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:43.115948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:43.195589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 828/1680] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:43 2022] PUT /identity/v3/projects/7ab1466b824e479b9d7957141177d259/users/b8bd6c5917ac4d068a1629e320098fa6/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:43.201090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:43.209357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:43.267225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 853/1681] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:43.268850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:43.271279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:43.271612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.308176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:43.311246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:43.395533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9610bc-bdeb-41bb-9a12-9b4f0f7a2ddb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:43.412094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 854/1682] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:43.412094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:43.415485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:43.423867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:43.425214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:43.425214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:43.425786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] PATH_INFO: `/v3/users/06f290ec2cba4a658ff44752ea49a247` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.428148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f290ec2cba4a658ff44752ea49a247)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:43.430518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:43.574087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9a332-b131-4e07-aa05-4395b76d8f19 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:43.593612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:43.596658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:43.598381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:43.598681 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.719753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f290ec2cba4a658ff44752ea49a247'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:43.722738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f290ec2cba4a658ff44752ea49a247'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:43.722841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:43.725371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:43.732405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f290ec2cba4a658ff44752ea49a247'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:43.751691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 855/1683] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:43.753287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:43.755891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:43.760113 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f290ec2cba4a658ff44752ea49a247'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:43.761688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-807da71b-522e-473c-b29c-d9f37b17b5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f290ec2cba4a658ff44752ea49a247'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:43.875821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9213-a53e-4385-9a9e-5e39c1cf3a88 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:43.882642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:43.883433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:43.883958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:43.884382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.887098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:43.903272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:43.910027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:43.911642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 829/1684] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:43 2022] DELETE /identity/v3/users/06f290ec2cba4a658ff44752ea49a247 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:43.918728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:43.919226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:43.919709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:43.951960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 856/1685] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:43.989848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:43.991343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:44.073309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 830/1686] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:44.106242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:44.107841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:44.145305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c615-ff23-4db3-adae-4d6dfa3e466e service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:44.266182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7cc82-b8b0-455a-a07b-cbb56279b03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:44.267510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7cc82-b8b0-455a-a07b-cbb56279b03a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:44.268495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7cc82-b8b0-455a-a07b-cbb56279b03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:44.269583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7cc82-b8b0-455a-a07b-cbb56279b03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:44.295587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7cc82-b8b0-455a-a07b-cbb56279b03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:44.297720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7cc82-b8b0-455a-a07b-cbb56279b03a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:44.312253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 857/1687] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:44.349683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:44.351257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:44.367503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ce485-a101-466d-b02f-d5a2b8d577e9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:44.374617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:44.375598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:44.376197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:44.397047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] PATH_INFO: `/v3/projects/c567d5d203c8413189811e292ad89149` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:44.409503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c567d5d203c8413189811e292ad89149)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:44.426038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:44.556109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c567d5d203c8413189811e292ad89149', 'request_id': 'req-787bddbb-01ad-4595-a47a-96bb5ca954a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:44.563864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c567d5d203c8413189811e292ad89149', 'request_id': 'req-787bddbb-01ad-4595-a47a-96bb5ca954a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:44.667317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c567d5d203c8413189811e292ad89149', 'request_id': 'req-787bddbb-01ad-4595-a47a-96bb5ca954a1'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:44.684994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] The token cache is being invalidate because project c567d5d203c8413189811e292ad89149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:44.685292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:44.686523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-787bddbb-01ad-4595-a47a-96bb5ca954a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:44.690345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 831/1688] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:44 2022] DELETE /identity/v3/projects/c567d5d203c8413189811e292ad89149 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:44.696062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:44.697266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:44.699503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:44.746521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:44.747818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:44.874140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 858/1689] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:44.882210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:44.882833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:44.882915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:44.919872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:44.928044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:44.941778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 832/1690] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:44.952311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:44.965273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35316b04-b1c6-40f6-9cdf-25f437e87498 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:44.977400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:44.978936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:44.978936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:44.978936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:44.981579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:44.982192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:44.984217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508e28f-6720-4f1c-a923-67b627009bb7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.002833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 859/1691] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:45.012730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.029011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ffa71-39dc-4d9e-a2b2-5f8c3224646e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:45.036056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:45.036983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.037413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.037827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.039370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:45.042681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.056672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.056992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.058013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.082306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] MFA Rules not processed for user `af7e95f4699840629cda1680de65d77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:45.083809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:45.157204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 833/1692] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:45 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:18:45.161428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.236727 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 860/1693] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:45.364442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e509b-c08e-40da-af54-45f8a0fa41fd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:45.384072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:45.393205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.393205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.393205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.393205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:45.405899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.553870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 834/1694] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:45 2022] POST /identity/v3/users => generated 284 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:45.561615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.594611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fada09-79b1-4099-9c6d-d5bc294293ae None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:45.609730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:45.613584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.613584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.613584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.613584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:45.619423 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.653400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 861/1695] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:18:45.657658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.674837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96e86-a89b-451f-81ba-f6203a9f4491 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:45.694888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:45.696335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.699826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.700446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.701437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:45.703824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.717761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 835/1696] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:45.725626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.753809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.761096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:45.762583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c80e1e-aea5-4b63-95ff-a54c9355ec79 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:45.774749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:45.794456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.795261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.798991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] PATH_INFO: `/v3/projects/db17d9871d394028a921840f6e0a55dc/users/a64d5389a848446e852808f83f43a8b9/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.840427 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841417b-aed1-4158-9714-7e783c66077e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:45.844097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=db17d9871d394028a921840f6e0a55dc, user_id=a64d5389a848446e852808f83f43a8b9, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:45.855103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:45.859807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.864726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:45.865562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:45.866313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] PATH_INFO: `/v3/projects/7a501243b9c1481fbf2c5a0498b3c275` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:45.869112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a501243b9c1481fbf2c5a0498b3c275)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:45.872616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:45.979386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 862/1697] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:45 2022] PUT /identity/v3/projects/db17d9871d394028a921840f6e0a55dc/users/a64d5389a848446e852808f83f43a8b9/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:45.987640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:45.989942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:46.056808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a501243b9c1481fbf2c5a0498b3c275', 'request_id': 'req-7473ef0f-a491-4100-94c0-cc11d0165975'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.068123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a501243b9c1481fbf2c5a0498b3c275', 'request_id': 'req-7473ef0f-a491-4100-94c0-cc11d0165975'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.120385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c4e70-7b6e-4425-bc0b-c5571778d4fa admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:46.163394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a501243b9c1481fbf2c5a0498b3c275', 'request_id': 'req-7473ef0f-a491-4100-94c0-cc11d0165975'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.181589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] The token cache is being invalidate because project 7a501243b9c1481fbf2c5a0498b3c275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:46.182734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.183571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7473ef0f-a491-4100-94c0-cc11d0165975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.187213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 836/1698] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:45 2022] DELETE /identity/v3/projects/7a501243b9c1481fbf2c5a0498b3c275 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:46.189791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.190419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.191594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.240967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] MFA Rules not processed for user `a64d5389a848446e852808f83f43a8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:46.242658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:46.292092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:46.293209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.293500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.293774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] PATH_INFO: `/v3/users/d2f8cdceb682478a88228b850e91fc1e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.295449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f8cdceb682478a88228b850e91fc1e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:46.297108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:46.452840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 837/1699] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:46.452840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:46.455112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:46.481620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90e773-ea1f-4aa3-9178-98ab0be10bf9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:46.492393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:46.493252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.493466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.493924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] PATH_INFO: `/v3/users/3d23f8ed4a6446b19547878658ca7c01` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.498545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d23f8ed4a6446b19547878658ca7c01)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:46.500545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:46.574486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f8cdceb682478a88228b850e91fc1e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.698372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f8cdceb682478a88228b850e91fc1e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.723920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f8cdceb682478a88228b850e91fc1e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.754032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d23f8ed4a6446b19547878658ca7c01'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.755435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f8cdceb682478a88228b850e91fc1e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.756570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d23f8ed4a6446b19547878658ca7c01'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.756730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f8cdceb682478a88228b850e91fc1e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.768636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 863/1700] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:45 2022] DELETE /identity/v3/users/d2f8cdceb682478a88228b850e91fc1e => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:18:46.776754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:46.776754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:46.777055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d23f8ed4a6446b19547878658ca7c01'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.792466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d23f8ed4a6446b19547878658ca7c01'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.793585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8eb456bd-6515-4b9e-907d-ae538c291ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d23f8ed4a6446b19547878658ca7c01'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:46.850743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779890-b6b2-4eac-a054-4b8193fcc289 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:46.855402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:46.856126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.856443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.856724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.858974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:46.935937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:46.936356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 838/1701] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:46 2022] DELETE /identity/v3/users/3d23f8ed4a6446b19547878658ca7c01 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:46.938040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b916-832e-4c2a-b746-18b99a932d6e None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.939410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b916-832e-4c2a-b746-18b99a932d6e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.941539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c2764-f41b-4aec-a416-ea4b575f811e service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:46.953753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 864/1702] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:46.954321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296b916-832e-4c2a-b746-18b99a932d6e None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.955373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85c0e-d46b-49e5-b026-cf6d791a45bc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.955667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85c0e-d46b-49e5-b026-cf6d791a45bc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.955949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85c0e-d46b-49e5-b026-cf6d791a45bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.965158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 839/1703] 10.222.0.49 () {54 vars in 912 bytes} [Mon Apr 11 13:18:46 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:46.968395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:46.968689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:46.968972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:46.976516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cbc85c0e-d46b-49e5-b026-cf6d791a45bc None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:46.978003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cbc85c0e-d46b-49e5-b026-cf6d791a45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.037243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:47.038494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.174377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 865/1704] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:47.176936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.177232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.192585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.226701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 840/1705] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:47.227711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:47.229178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.242819 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] MFA Rules not processed for user `b8bd6c5917ac4d068a1629e320098fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:47.244843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.254683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd9a3e-a40a-4650-9a37-13927802b420 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:47.306235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:47.306235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.306235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.306235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.314228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:47.315156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:47.345685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 841/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:47.346907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:47.348470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.378873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 866/1707] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:47.381384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342efc61-2a46-4947-8ec9-440cc97d7ed3 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:47.384448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:47.386301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.393044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef54d2-dbb1-490e-9601-06c3661584f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:47.394080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef54d2-dbb1-490e-9601-06c3661584f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.394586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef54d2-dbb1-490e-9601-06c3661584f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.407271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef54d2-dbb1-490e-9601-06c3661584f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.418011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef54d2-dbb1-490e-9601-06c3661584f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:47.420444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef54d2-dbb1-490e-9601-06c3661584f7 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:47.432987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 842/1708] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:47.488162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea4b4-f87c-4479-ad47-ef7251e76f2e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:47.499030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:47.499860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.502988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.502988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.503655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:47.507524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:47.531915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.531915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.532149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.573898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:47.577711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:47.652161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 867/1709] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:47 2022] POST /identity/v3/projects => generated 401 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:47.659486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:47.765833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb13cc-2e1a-4da5-8168-9a9b5e960e02 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:47.774583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:47.775670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.776750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.777886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.778879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:47.782008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:47.846846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 843/1710] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:47.896446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 868/1711] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:47 2022] POST /identity/v3/users => generated 307 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:47.902457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:47.929071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96070-4e11-45e5-ba5f-69dc4311cfce None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:47.944452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:47.945342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:47.945458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:47.945708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:47.946593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:47.949172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:47.972495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 844/1712] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:47.976657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:47.999511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94d3cf-9671-4179-b83f-5090ac955364 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:48.015365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:48.016540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:48.016975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:48.017431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] PATH_INFO: `/v3/projects/d493dc171ce347e19779ed544535f27e/users/c0ca933bc09e47caa593615ac093e788/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:48.101003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d493dc171ce347e19779ed544535f27e, user_id=c0ca933bc09e47caa593615ac093e788, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:48.107907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:48.131416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:48.133550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:48.165575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567292c-c59e-4af6-aa23-dd661345369c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:48.182660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:48.185391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:48.185391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:48.185391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] PATH_INFO: `/v3/projects/0691a508dfe24d1eb0e2ba65a07eece3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:48.188646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0691a508dfe24d1eb0e2ba65a07eece3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:48.190769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:48.261526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 869/1713] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:47 2022] PUT /identity/v3/projects/d493dc171ce347e19779ed544535f27e/users/c0ca933bc09e47caa593615ac093e788/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:18:48.264073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:48.397949 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0691a508dfe24d1eb0e2ba65a07eece3', 'request_id': 'req-0453e925-13d3-430c-a4af-0d6f17b47ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:48.408636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0691a508dfe24d1eb0e2ba65a07eece3', 'request_id': 'req-0453e925-13d3-430c-a4af-0d6f17b47ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:48.436332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac932d8f-91c4-43fb-847a-bcc85a0554c2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:48.498042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0691a508dfe24d1eb0e2ba65a07eece3', 'request_id': 'req-0453e925-13d3-430c-a4af-0d6f17b47ff8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:48.519435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] The token cache is being invalidate because project 0691a508dfe24d1eb0e2ba65a07eece3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:48.519734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:48.524641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:48.537894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 845/1714] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:48 2022] DELETE /identity/v3/projects/0691a508dfe24d1eb0e2ba65a07eece3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:48.537894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:48.540511 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:48.641313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb93b-6625-4c26-bd51-dcd57e4c6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:48.642168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb93b-6625-4c26-bd51-dcd57e4c6af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:48.642409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb93b-6625-4c26-bd51-dcd57e4c6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:48.643716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb93b-6625-4c26-bd51-dcd57e4c6af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:48.644563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb93b-6625-4c26-bd51-dcd57e4c6af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:48.646197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb93b-6625-4c26-bd51-dcd57e4c6af7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:48.689176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 870/1715] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:48.689176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:48.689176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:48.689176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:48.726789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:48.728489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:48.771103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 871/1716] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:48.772097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:48.773983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:48.776680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e925-13d3-430c-a4af-0d6f17b47ff8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:48.804915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:48.804915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:48.805183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:48.805437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:48.809713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:48.813230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8c9ff-9f81-4f75-a427-e4dceb01b33d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:48.827052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:48.829965 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:48.831006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:48.831006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] PATH_INFO: `/v3/projects/d493dc171ce347e19779ed544535f27e/users/c0ca933bc09e47caa593615ac093e788/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:48.835818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d493dc171ce347e19779ed544535f27e, user_id=c0ca933bc09e47caa593615ac093e788, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:48.843714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:48.878921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 872/1717] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:48 2022] PUT /identity/v3/projects/d493dc171ce347e19779ed544535f27e/users/c0ca933bc09e47caa593615ac093e788/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:48.883973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:48.892953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:48.973892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:48.977601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea78df4-0131-43bf-b9b7-b0cad0ab1ec1 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:49.005897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 846/1718] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:18:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:18:49.005897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.005897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.005897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:49.049176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:49.049176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:49.087460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205db4-0e6f-4d7f-b556-c6a265e8c35a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:49.112378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 847/1719] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:49.114061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:49.118014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:49.123514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.127285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.129143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] PATH_INFO: `/v3/projects/76db52af4527447e89bdb818b0408a55` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:49.137557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76db52af4527447e89bdb818b0408a55)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:49.144331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:49.164439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fa981-e09e-4d19-940e-42f562dc9750 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:49.193602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:49.194327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.194612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.194954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:49.195714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:49.196029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:49.210184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:49.253733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 848/1720] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:49.263262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:49.295637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c1af-4f69-4fcb-82eb-eb843ac098c7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:49.310990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:49.311764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.312016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.314992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:49.316775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:49.320404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:49.418852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76db52af4527447e89bdb818b0408a55', 'request_id': 'req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:49.459384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76db52af4527447e89bdb818b0408a55', 'request_id': 'req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:49.492285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 849/1721] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:49 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:49.496842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:49.599571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76db52af4527447e89bdb818b0408a55', 'request_id': 'req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:49.624548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] The token cache is being invalidate because project 76db52af4527447e89bdb818b0408a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:49.624869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:49.632043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1be4a72a-1880-4d5d-89eb-e36673bc2c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:49.642579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 873/1722] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:48 2022] DELETE /identity/v3/projects/76db52af4527447e89bdb818b0408a55 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:49.647960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ca64-7b94-4961-a44c-2ac3e6a7ad58 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.648560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ca64-7b94-4961-a44c-2ac3e6a7ad58 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.648560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ca64-7b94-4961-a44c-2ac3e6a7ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:49.729604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4530ca64-7b94-4961-a44c-2ac3e6a7ad58 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:49.734773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4530ca64-7b94-4961-a44c-2ac3e6a7ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:49.873493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7cd2d-d27f-484c-a0c8-84b14716b357 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:49.896648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:49.901681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.902345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.902587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:49.903306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:49.905472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:49.938979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 874/1723] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:49.959944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:49.960242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:49.960560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.018084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:50.109689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:50.110194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 850/1724] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:49 2022] POST /identity/v3/users => generated 284 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:18:50.115392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:50.129340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:50.144419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 875/1725] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:50.144618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:50.165678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ffdb-07e5-4ba7-9c44-b62fcec7557d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:50.171846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:50.172539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:50.172819 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:50.173176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.174058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:18:50.174427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:50.176469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:50.194037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 876/1726] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:18:50.201196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:50.205310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8d7a1-8104-4130-bcfc-52e417883985 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:50.217894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:50.221844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:50.225707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:50.228610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.232667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:50.233782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739ba90-b85b-4ea9-958b-472c132e234d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:50.245453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:50.263744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:50.279795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:50.282371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:50.283449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.288924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:50.292937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 851/1727] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:50.297925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:50.307775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:50.371594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2032-03a4-4398-a50d-57db0284f852 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:50.424173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:50.424899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:50.425189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:50.425631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.426506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:50.445895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:50.509554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 852/1728] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:50.511922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:50.543395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 877/1729] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:50 2022] POST /identity/v3/projects => generated 375 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:50.558932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:50.613007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaf137-8213-4308-8c12-01da9a8e80b3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:50.744127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:50.746440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:50.746933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:50.748367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] PATH_INFO: `/v3/projects/da740006fa564f10a0abc89643fc1788/users/127c376ff5424f22abcf42dfd1c0f85a/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.810160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=da740006fa564f10a0abc89643fc1788, user_id=127c376ff5424f22abcf42dfd1c0f85a, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:50.813848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:50.876053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2d37-2710-4fa1-b378-a68fc1a85516 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:50.884216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2e352-be02-4371-a1a5-c3f4b5f57f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:50.885895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e352-be02-4371-a1a5-c3f4b5f57f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:50.887117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e352-be02-4371-a1a5-c3f4b5f57f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:50.888236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e352-be02-4371-a1a5-c3f4b5f57f49 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:50.891086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2e352-be02-4371-a1a5-c3f4b5f57f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:50.894379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2e352-be02-4371-a1a5-c3f4b5f57f49 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:51.117310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 878/1730] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:50 2022] POST /identity/v3/users => generated 288 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:51.122164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 853/1731] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:50 2022] PUT /identity/v3/projects/da740006fa564f10a0abc89643fc1788/users/127c376ff5424f22abcf42dfd1c0f85a/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:51.127700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c510f3e-c841-4c55-b7ce-03d2b1d8dc82 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.130134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c510f3e-c841-4c55-b7ce-03d2b1d8dc82 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.130134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c510f3e-c841-4c55-b7ce-03d2b1d8dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.134247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:51.200472 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5c510f3e-c841-4c55-b7ce-03d2b1d8dc82 None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:51.201829 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c510f3e-c841-4c55-b7ce-03d2b1d8dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:51.467671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 879/1732] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Apr 11 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:51.470295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2042e-8cf3-409b-be35-9dc1a1f36ebf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:51.472163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.472455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.472735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.485441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3094dd-0f3f-41fc-8cd1-3f59a76c4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:51.488474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3094dd-0f3f-41fc-8cd1-3f59a76c4f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.489055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3094dd-0f3f-41fc-8cd1-3f59a76c4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.489055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3094dd-0f3f-41fc-8cd1-3f59a76c4f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.490227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3094dd-0f3f-41fc-8cd1-3f59a76c4f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:51.494601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3094dd-0f3f-41fc-8cd1-3f59a76c4f8d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:51.500050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:51.501977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:51.509453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 854/1733] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:51.514590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.517972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.518588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.539305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 880/1734] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:51.540767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:51.544787 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] MFA Rules not processed for user `1645581d13c54204a0f32a67738fd2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:51.546302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:51.547539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:51.591207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4b613-a028-4814-9df1-0655f7df4909 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:51.598437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:51.598903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.599712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.600468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.618910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:51.624103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:51.639274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 881/1735] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:51.641300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:51.673675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675d976-5218-4d37-babf-e07fb526d40f service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:51.691270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:51.692097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.692468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.693039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.694823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:51.703409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:51.722930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 855/1736] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:51.723635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:51.725865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:51.743832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d29fc-3dcd-4b2d-bf3f-b8a17fa137f1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:51.751931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f595e-419e-4725-9c90-3eeff4846198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:51.752337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 882/1737] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:18:51.753097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f595e-419e-4725-9c90-3eeff4846198 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.753626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f595e-419e-4725-9c90-3eeff4846198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.754129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f595e-419e-4725-9c90-3eeff4846198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.756041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:51.782972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab5ea-e36e-4f4b-964c-d129cc619532 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:51.784339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f595e-419e-4725-9c90-3eeff4846198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:51.787256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f595e-419e-4725-9c90-3eeff4846198 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:51.816321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:51.817517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:51.818687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:51.819016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] PATH_INFO: `/v3/projects/5c71c32aa10e4cef8f7774661133e07e/users/c5d331a3be68480a943c5b1287335403/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:51.844985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 856/1738] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:51.867526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c71c32aa10e4cef8f7774661133e07e, user_id=c5d331a3be68480a943c5b1287335403, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:51.867526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:51.996314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 883/1739] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:51 2022] PUT /identity/v3/projects/5c71c32aa10e4cef8f7774661133e07e/users/c5d331a3be68480a943c5b1287335403/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:18:52.006627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:52.006948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:52.007266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:52.110510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] MFA Rules not processed for user `c5d331a3be68480a943c5b1287335403`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:52.114569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:52.372136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 857/1740] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:52.533865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:52.539449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:52.793941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6644f-754c-4f10-ab0d-1a801fa70fae admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:52.821163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70100a-81f5-4c52-b2a1-8cab7c91b557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:52.821163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70100a-81f5-4c52-b2a1-8cab7c91b557 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:52.821163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70100a-81f5-4c52-b2a1-8cab7c91b557 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:52.821163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70100a-81f5-4c52-b2a1-8cab7c91b557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:52.849577 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70100a-81f5-4c52-b2a1-8cab7c91b557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:52.851976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70100a-81f5-4c52-b2a1-8cab7c91b557 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:52.892098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 884/1741] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:53.759691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:53.937969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5657a-e4da-4c8d-ab64-cc754fb2853f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:53.950763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:53.952448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:53.953104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:53.953838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] PATH_INFO: `/v3/users/c5d331a3be68480a943c5b1287335403` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:53.955618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d331a3be68480a943c5b1287335403)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:53.961599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:54.242890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d331a3be68480a943c5b1287335403'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:54.246813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:54.247548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d331a3be68480a943c5b1287335403'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:54.248589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:54.248685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:54.271715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d331a3be68480a943c5b1287335403'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:54.312342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d331a3be68480a943c5b1287335403'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:54.314639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-597c76a2-59ed-4ba8-a359-64653b28f8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d331a3be68480a943c5b1287335403'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:54.330164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] MFA Rules not processed for user `c0ca933bc09e47caa593615ac093e788`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:54.331998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:54.427753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 858/1742] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:18:53 2022] DELETE /identity/v3/users/c5d331a3be68480a943c5b1287335403 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:54.429832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40a51b-ad84-4839-95fc-a18fddad6d46 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:54.431128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40a51b-ad84-4839-95fc-a18fddad6d46 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:54.431494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40a51b-ad84-4839-95fc-a18fddad6d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:54.484865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8c40a51b-ad84-4839-95fc-a18fddad6d46 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:54.497260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c40a51b-ad84-4839-95fc-a18fddad6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:54.587785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 885/1743] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:54.668208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 859/1744] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:18:54.700379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:54.705603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:54.867663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcf506-f17e-4217-8434-284441fdbe84 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:54.985733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb50d5-e8c3-4ce0-974d-08e56f1f68a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:54.986755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb50d5-e8c3-4ce0-974d-08e56f1f68a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:54.987045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb50d5-e8c3-4ce0-974d-08e56f1f68a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:54.987322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb50d5-e8c3-4ce0-974d-08e56f1f68a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:55.017596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb50d5-e8c3-4ce0-974d-08e56f1f68a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:55.019198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb50d5-e8c3-4ce0-974d-08e56f1f68a0 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:55.045511 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594aa6-2659-48d5-9eec-1f5471adb72f None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:55.047624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594aa6-2659-48d5-9eec-1f5471adb72f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:55.048129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594aa6-2659-48d5-9eec-1f5471adb72f None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:55.050880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 886/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:55.053284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 860/1746] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:18:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:18:55.059758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:55.060060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:55.060335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:55.116571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:55.119342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:55.289028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 887/1747] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:55.522803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:55.523081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:55.523549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:55.580869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:55.582441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:55.606076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] MFA Rules not processed for user `127c376ff5424f22abcf42dfd1c0f85a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:55.608461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:55.643817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77af31-9c95-4946-8d6a-f374afb7ec84 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:55.686384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:55.688997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:55.688997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:55.690870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:55.734710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:55.736475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:55.777880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 888/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:18:55.861407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 861/1749] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:55.867844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:55.870680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:55.890994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0de97-c49b-4f9e-9cd2-beb5afec0a02 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:55.897746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:55.898518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:55.898849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:55.899131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:55.899987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:55.903394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:56.107136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:56.120318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 889/1750] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:18:55 2022] POST /identity/v3/projects => generated 371 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:56.137529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07bc6b-a876-432a-9d8b-bdcaf16a5b94 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:56.318295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:56.320159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:56.322075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:56.324933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:56.327037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:56.333494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:56.541180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 862/1751] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:18:56 2022] POST /identity/v3/users => generated 292 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:18:56.542068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:56.571391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7368027-bbcf-47c3-9b0b-db9a2ec7df29 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:56.600094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:56.600094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:56.600094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:56.600094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:56.600559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:56.600559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:56.631392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 890/1752] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:18:56.632087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:56.647075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641584-8b03-40ba-8354-d9be46520588 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:56.673450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:56.674914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:56.675371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:56.675724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] PATH_INFO: `/v3/projects/22a8ff779ed44023af0b817fdbba4077/users/2a1f84f903d245eab75c45adbc116c2e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:56.733252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a8ff779ed44023af0b817fdbba4077, user_id=2a1f84f903d245eab75c45adbc116c2e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:56.744800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:56.840409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 863/1753] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:56 2022] PUT /identity/v3/projects/22a8ff779ed44023af0b817fdbba4077/users/2a1f84f903d245eab75c45adbc116c2e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:56.844238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:56.873419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7e7f-8d35-4c70-968a-f41d27a87bca admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:56.995030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:56.995933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:56.996469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:56.996745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:56.997561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:57.005135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:57.033553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 891/1754] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:18:57.042671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:57.073617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf895-68ef-4dc7-83ec-7ad2ab65f6f8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:57.081077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bf922-066c-44f4-aabc-4503f37af33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:57.081994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bf922-066c-44f4-aabc-4503f37af33e admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:57.082317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bf922-066c-44f4-aabc-4503f37af33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:57.082586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bf922-066c-44f4-aabc-4503f37af33e admin admin] PATH_INFO: `/v3/projects/22a8ff779ed44023af0b817fdbba4077/users/2a1f84f903d245eab75c45adbc116c2e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:57.084959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bf922-066c-44f4-aabc-4503f37af33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a8ff779ed44023af0b817fdbba4077, user_id=2a1f84f903d245eab75c45adbc116c2e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:57.089331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bf922-066c-44f4-aabc-4503f37af33e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:57.106570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 864/1755] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:18:57 2022] PUT /identity/v3/projects/22a8ff779ed44023af0b817fdbba4077/users/2a1f84f903d245eab75c45adbc116c2e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:59.106897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:59.111048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:59.178796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042b885-b384-408c-bbed-f68b0283486f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:18:59.365348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:18:59.367003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:59.368447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:59.368843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] PATH_INFO: `/v3/projects/5c71c32aa10e4cef8f7774661133e07e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:59.373062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c71c32aa10e4cef8f7774661133e07e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:18:59.379196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:18:59.555696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c71c32aa10e4cef8f7774661133e07e', 'request_id': 'req-0d500d41-6e0a-431b-a428-90444a85c634'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:59.570545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c71c32aa10e4cef8f7774661133e07e', 'request_id': 'req-0d500d41-6e0a-431b-a428-90444a85c634'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:59.631938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:59.637681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:59.640581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:59.705133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] MFA Rules not processed for user `2a1f84f903d245eab75c45adbc116c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:59.706849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:59.709702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c71c32aa10e4cef8f7774661133e07e', 'request_id': 'req-0d500d41-6e0a-431b-a428-90444a85c634'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:59.733337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] The token cache is being invalidate because project 5c71c32aa10e4cef8f7774661133e07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:18:59.733337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:59.733615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0d500d41-6e0a-431b-a428-90444a85c634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:18:59.741638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 892/1756] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:18:59 2022] DELETE /identity/v3/projects/5c71c32aa10e4cef8f7774661133e07e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:18:59.749358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd9e0-0438-4d57-a7cf-886be9c5ddbf None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:59.750398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd9e0-0438-4d57-a7cf-886be9c5ddbf None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:59.752646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd9e0-0438-4d57-a7cf-886be9c5ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:18:59.807169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-238fd9e0-0438-4d57-a7cf-886be9c5ddbf None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:18:59.808751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-238fd9e0-0438-4d57-a7cf-886be9c5ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:59.932649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 865/1757] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:59.953176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:18:59.954772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:18:59.980037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 893/1758] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:18:59.993814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:18:59.993985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:18:59.997010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:00.067817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:00.067817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:00.075160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 894/1759] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:00.081242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:00.113530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87b6c-6f9c-45ad-8957-7c1a6ede16e3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:00.129037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:00.131692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:00.132143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:00.134020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:00.138166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:00.139289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:00.141514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:00.156849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc3bcd-1f5b-407e-9757-190ed77ba687 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:00.167175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:00.167952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:00.168294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:00.168645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:00.173252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:00.189188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 895/1760] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:19:00.199052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:00.235898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d77de-1b2f-4f8b-ba3c-317d0d417874 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:00.260066 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:00.261560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:00.262075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:00.262571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:00.263726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:00.266045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:00.300844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:00.308812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:00.329340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 866/1761] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:00.459411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 896/1762] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:00 2022] POST /identity/v3/projects => generated 369 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:00.462193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:00.489686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c32faf-a13e-471e-a168-228f51d4126a service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:00.751968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:00.752702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:00.760273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:00.760273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:00.760273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:00.760273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:01.002684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 867/1763] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:00 2022] POST /identity/v3/users => generated 285 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:01.006627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:01.020726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20daaae-8ea5-43a2-aaf5-d73082a0d6c1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:01.031894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:01.033358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:01.033494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:01.035633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:01.037015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:01.038794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:01.059321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:01.061487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:01.062808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 897/1764] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:01.066922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:01.092180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa160a-cd55-4447-bce9-4d47541119af admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:01.111865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e0e10-70bb-4df3-a332-54c4fcd92af0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:01.130845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:01.131543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:01.131857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:01.132140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:01.133082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:01.134792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:01.138783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:01.139801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:01.140867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:01.141131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] PATH_INFO: `/v3/users/b8bd6c5917ac4d068a1629e320098fa6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:01.145438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bd6c5917ac4d068a1629e320098fa6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:01.150622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:01.164182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 898/1765] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:01.168784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:01.185546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca521d9-59d5-48ac-8c72-78bfc2d0b4d9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:01.206721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5948426-7365-4062-91ae-4e3d164ea49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:01.223423 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5948426-7365-4062-91ae-4e3d164ea49e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:01.224838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5948426-7365-4062-91ae-4e3d164ea49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:01.227183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5948426-7365-4062-91ae-4e3d164ea49e admin admin] PATH_INFO: `/v3/projects/7f8de5ebbf6a443aa462862327c6c080/users/cfb045f163c84ac48694ef931de56e4f/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:01.282261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5948426-7365-4062-91ae-4e3d164ea49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8de5ebbf6a443aa462862327c6c080, user_id=cfb045f163c84ac48694ef931de56e4f, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:01.285968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5948426-7365-4062-91ae-4e3d164ea49e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:01.422048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 899/1766] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:01 2022] PUT /identity/v3/projects/7f8de5ebbf6a443aa462862327c6c080/users/cfb045f163c84ac48694ef931de56e4f/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:01.436673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:01.437275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:01.437734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:01.441491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bd6c5917ac4d068a1629e320098fa6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:01.442425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bd6c5917ac4d068a1629e320098fa6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:01.451666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bd6c5917ac4d068a1629e320098fa6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:01.470655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] MFA Rules not processed for user `cfb045f163c84ac48694ef931de56e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:01.472025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:01.474138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bd6c5917ac4d068a1629e320098fa6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:01.475182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bd6c5917ac4d068a1629e320098fa6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:01.566325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 900/1767] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:01.567567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:01.571467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:01.601282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 868/1768] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:01 2022] DELETE /identity/v3/users/b8bd6c5917ac4d068a1629e320098fa6 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:01.743978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87056c-9850-4a35-b0a0-a4612106c4f1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:01.911174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:01.914402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:01.914506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:01.914824 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:01.916832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:01.922870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.075504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 901/1769] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:01 2022] POST /identity/v3/projects => generated 369 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:02.077573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.109906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b749a-171b-4db7-88f4-99b3e00d6724 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:02.212091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:02.212091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.212091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.212091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.212415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:02.212415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.237326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.239121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:02.275184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fbac2-f65d-454d-bbdd-437447154929 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:02.287322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:02.293321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.295187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.295584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] PATH_INFO: `/v3/users/a64d5389a848446e852808f83f43a8b9` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.299232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64d5389a848446e852808f83f43a8b9)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:02.305191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.318980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 869/1770] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:02 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:02.321056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.335049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f66d-aa86-4865-aed3-d181325578e0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:02.342644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:02.344439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.344933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.345444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.346563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:02.348410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.377111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 870/1771] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:02.380298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.395766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bad6e-5460-4017-976f-c6892c6c67fc admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:02.404415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:02.430339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.430339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.431505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] PATH_INFO: `/v3/projects/22cd0ad7467949809041c5e9c0c3d172/users/6a4bf82f7e324584a8692c2ce35b7bce/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.455745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cd0ad7467949809041c5e9c0c3d172, user_id=6a4bf82f7e324584a8692c2ce35b7bce, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:02.461270 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.561899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 871/1772] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:02 2022] PUT /identity/v3/projects/22cd0ad7467949809041c5e9c0c3d172/users/6a4bf82f7e324584a8692c2ce35b7bce/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:02.567019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.574381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64d5389a848446e852808f83f43a8b9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:02.665378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64d5389a848446e852808f83f43a8b9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:02.687835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57a76-79e5-4b1f-ad9f-5a54acc3bcae admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:02.693505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64d5389a848446e852808f83f43a8b9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:02.694868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:02.695393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.695681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.695953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.696933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:02.699432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.714560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64d5389a848446e852808f83f43a8b9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:02.715384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-bebec2a7-f15d-44e7-88aa-2b38786c2e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64d5389a848446e852808f83f43a8b9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:02.723111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 872/1773] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:02.727057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.727057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:02.735701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 902/1774] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:02 2022] DELETE /identity/v3/users/a64d5389a848446e852808f83f43a8b9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:02.737279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ac318-9150-4306-898f-6f22015651fc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.737577 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ac318-9150-4306-898f-6f22015651fc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.738206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ac318-9150-4306-898f-6f22015651fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.750599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b155eab-f080-466b-b0f6-0bdd50fc127c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:02.780289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-310ac318-9150-4306-898f-6f22015651fc None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:02.783857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-310ac318-9150-4306-898f-6f22015651fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:02.887429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357a149-b689-4378-a588-9af487f0a020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:02.888446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a149-b689-4378-a588-9af487f0a020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.890450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a149-b689-4378-a588-9af487f0a020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.890888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a149-b689-4378-a588-9af487f0a020 admin admin] PATH_INFO: `/v3/projects/22cd0ad7467949809041c5e9c0c3d172/users/6a4bf82f7e324584a8692c2ce35b7bce/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.894625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a149-b689-4378-a588-9af487f0a020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cd0ad7467949809041c5e9c0c3d172, user_id=6a4bf82f7e324584a8692c2ce35b7bce, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:02.900466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a149-b689-4378-a588-9af487f0a020 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:02.925739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 873/1775] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:02 2022] PUT /identity/v3/projects/22cd0ad7467949809041c5e9c0c3d172/users/6a4bf82f7e324584a8692c2ce35b7bce/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:02.930036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 903/1776] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:02.940474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:02.941238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:02.941569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:02.943631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ac318-9150-4306-898f-6f22015651fc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:02.947368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-310ac318-9150-4306-898f-6f22015651fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.032871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] MFA Rules not processed for user `6a4bf82f7e324584a8692c2ce35b7bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:03.034736 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.131342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 874/1777] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:03.132316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:03.139034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.152500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ac318-9150-4306-898f-6f22015651fc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:03.230719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615b7dd-d954-4f80-839f-da284ef6db25 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:03.238398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:03.239427 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.239899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.240964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.250625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:03.251309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.251638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.251967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.258449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.330528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:03.331755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:03.344268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 904/1778] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:03.345111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:03.346669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.362205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb037a6-9f34-4710-9f88-7ba8b1ba2942 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:03.367743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:03.368643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.368926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.369203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] PATH_INFO: `/v3/projects/7ab1466b824e479b9d7957141177d259` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.371579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab1466b824e479b9d7957141177d259)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:03.372734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:03.373764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:03.374794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:03.389046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 875/1779] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:03.390220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:03.392260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.411387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3748-d322-4163-bdfc-297cbe108814 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:03.415493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cef36-6833-4c76-ba60-c96467ecc43e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:03.417479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cef36-6833-4c76-ba60-c96467ecc43e service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.417794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cef36-6833-4c76-ba60-c96467ecc43e service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.418258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cef36-6833-4c76-ba60-c96467ecc43e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.430723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cef36-6833-4c76-ba60-c96467ecc43e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:03.433272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cef36-6833-4c76-ba60-c96467ecc43e service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:03.484709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 876/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:03.484709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773da28-5736-4ae7-b41b-cd5df2c5c7f1 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.484709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773da28-5736-4ae7-b41b-cd5df2c5c7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.484709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773da28-5736-4ae7-b41b-cd5df2c5c7f1 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.484709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 877/1781] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:19:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:19:03.499042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab1466b824e479b9d7957141177d259', 'request_id': 'req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:03.515548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab1466b824e479b9d7957141177d259', 'request_id': 'req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:03.555063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.555478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.556523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.597312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:03.597656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.629083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab1466b824e479b9d7957141177d259', 'request_id': 'req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:03.656874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] The token cache is being invalidate because project 7ab1466b824e479b9d7957141177d259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:03.657519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:03.658547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:03.660205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 905/1782] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:03 2022] DELETE /identity/v3/projects/7ab1466b824e479b9d7957141177d259 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:03.664179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:03.665787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.805987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 878/1783] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:19:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:03.830858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ac0a-1537-43ee-9891-dd15f4920d1b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:03.847187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:03.848192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.848549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.848907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] PATH_INFO: `/v3/users/c0ca933bc09e47caa593615ac093e788` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.850404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ca933bc09e47caa593615ac093e788)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:03.856685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:03.911261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:03.912906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:03.952296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ed4f-e97a-4fb5-9f24-93781a00d711 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:03.959314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:03.960088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:03.960463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:03.960856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:03.972219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:03.974536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:03.989729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 879/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:04.091821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ca933bc09e47caa593615ac093e788'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.145838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:04.147477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:04.172300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f49c0-123d-47d7-b11a-38779d6f6c98 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:04.181057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:04.183549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.183549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.183549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] PATH_INFO: `/v3/projects/db17d9871d394028a921840f6e0a55dc` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.184468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ca933bc09e47caa593615ac093e788'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.185061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db17d9871d394028a921840f6e0a55dc)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:04.196759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ca933bc09e47caa593615ac093e788'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.202555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:04.232822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ca933bc09e47caa593615ac093e788'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.234181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-151556c2-4826-4468-8967-9ac56bd4f354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ca933bc09e47caa593615ac093e788'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.241179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 906/1785] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:03 2022] DELETE /identity/v3/users/c0ca933bc09e47caa593615ac093e788 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:04.404769 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db17d9871d394028a921840f6e0a55dc', 'request_id': 'req-219b8a80-bbbc-4364-95b0-c32548dd1c7a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.413075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db17d9871d394028a921840f6e0a55dc', 'request_id': 'req-219b8a80-bbbc-4364-95b0-c32548dd1c7a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.520820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db17d9871d394028a921840f6e0a55dc', 'request_id': 'req-219b8a80-bbbc-4364-95b0-c32548dd1c7a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.535734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] The token cache is being invalidate because project db17d9871d394028a921840f6e0a55dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:04.536153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.536819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.538444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 880/1786] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:04 2022] DELETE /identity/v3/projects/db17d9871d394028a921840f6e0a55dc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:04.544048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408c61-4583-43ab-b4f6-d22a0378d7c0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.544655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408c61-4583-43ab-b4f6-d22a0378d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.544655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408c61-4583-43ab-b4f6-d22a0378d7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.563973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-92408c61-4583-43ab-b4f6-d22a0378d7c0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:04.565479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-92408c61-4583-43ab-b4f6-d22a0378d7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:04.622920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:04.624652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:04.644319 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 907/1787] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:04.658411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.658768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.659058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.682272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:04.683496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:04.692236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 908/1788] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:04.696934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:04.706929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6452c1-7a36-49a7-b855-911279f4d15d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:04.710842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8a80-bbbc-4364-95b0-c32548dd1c7a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:04.712240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:04.712967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.713877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.714220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.715054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:04.715365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:04.716402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:04.716981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:04.717335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.717643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.717921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] PATH_INFO: `/v3/projects/d493dc171ce347e19779ed544535f27e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.719214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d493dc171ce347e19779ed544535f27e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:04.721155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:04.732688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 909/1789] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:04.733782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:04.746026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0607-cfb9-473e-b659-2d3195b37c0b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:04.749702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:04.750392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.750672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.750946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.751634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:04.753678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:04.920547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 910/1790] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:04 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:04.924783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:04.933942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd493dc171ce347e19779ed544535f27e', 'request_id': 'req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.940355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd493dc171ce347e19779ed544535f27e', 'request_id': 'req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:04.990176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf283e91-b3fb-4075-94fe-bea06dd79c5a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:04.996511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:04.997262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:04.997605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:04.997894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:04.998675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.000920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.046534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd493dc171ce347e19779ed544535f27e', 'request_id': 'req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:05.060771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] The token cache is being invalidate because project d493dc171ce347e19779ed544535f27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:05.063295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:05.063295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a0b3bc11-7d0c-497b-95ba-0e9f44efde95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:05.065477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 881/1791] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:04 2022] DELETE /identity/v3/projects/d493dc171ce347e19779ed544535f27e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:05.070799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fbec4-940b-4a21-aa8f-9790801bf7dc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.071086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fbec4-940b-4a21-aa8f-9790801bf7dc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.071368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fbec4-940b-4a21-aa8f-9790801bf7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.090789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3f5fbec4-940b-4a21-aa8f-9790801bf7dc None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:05.091998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3f5fbec4-940b-4a21-aa8f-9790801bf7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:05.100572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 882/1792] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:05.115245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.115558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.115844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.136628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:05.137139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:05.140155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 911/1793] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:04 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:05.141091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.142942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:05.147190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 883/1794] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:05.152327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.165969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38494f-a36b-48dc-95cb-30479683f082 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.166140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605ddf-2244-4f16-854f-a7e562048208 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.170565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.171338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.171611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.171887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.172708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.174446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.186447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 912/1795] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:05.190688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.201287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.203171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.203465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.203746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.204964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d21c1-478b-42e5-a2d8-124a330edac7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.206772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:05.207120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.208768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.218779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.219571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.220846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.221203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.222021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.224474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.234316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 884/1796] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:05.235417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.248833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10767026-cf8a-44f9-91dc-fb0a229b216d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.256423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.257251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.257604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.257916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 913/1797] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:05.259273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.260114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.263330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.271482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.288112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c1262-8610-47d3-b70f-ba43e793db90 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.299431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea980423-5a29-4ee9-a11a-87438ec4df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.300812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980423-5a29-4ee9-a11a-87438ec4df08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.302332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980423-5a29-4ee9-a11a-87438ec4df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.302773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980423-5a29-4ee9-a11a-87438ec4df08 admin admin] PATH_INFO: `/v3/projects/c0a3077ce7274f8b936b64cc3a6fc0b6/users/21212a2d8d4945fb9a4d669f88c5d3f2/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.323623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea980423-5a29-4ee9-a11a-87438ec4df08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a3077ce7274f8b936b64cc3a6fc0b6, user_id=21212a2d8d4945fb9a4d669f88c5d3f2, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.327130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea980423-5a29-4ee9-a11a-87438ec4df08 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.372869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 885/1798] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:05.377992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.463783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 914/1799] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:05 2022] PUT /identity/v3/projects/c0a3077ce7274f8b936b64cc3a6fc0b6/users/21212a2d8d4945fb9a4d669f88c5d3f2/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:05.487891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.491710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.491710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.499946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18268f-9ef4-4556-9a3e-87b62367ead7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.532897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] MFA Rules not processed for user `21212a2d8d4945fb9a4d669f88c5d3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:05.534787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:05.589361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.590127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.590427 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.590699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.591576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.593908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.662414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 915/1800] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:05.668229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.681532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42dc12-9b9a-465a-97a3-323387792acc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.687767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.688440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.688792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.689087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.689751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.691781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.703143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 886/1801] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/users => generated 290 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:05.707189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.718340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568d0e0-62c6-45bc-8af7-d62bbc4be175 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.723493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.724470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.724895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.725180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.726066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.727588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.738751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 887/1802] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:05.744726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.756285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631363f-2646-4daa-a254-45212c73d111 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.763675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.764459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.764741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.765018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.765785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.769635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.779396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 888/1803] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:05.783510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.793812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf83605-6f0f-4832-a7cc-17d41c1f3206 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:05.798530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f70a1-e4ae-4b53-bc4c-15f0e750da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:05.799583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f70a1-e4ae-4b53-bc4c-15f0e750da00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.799872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f70a1-e4ae-4b53-bc4c-15f0e750da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.800151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f70a1-e4ae-4b53-bc4c-15f0e750da00 admin admin] PATH_INFO: `/v3/projects/35afd9a6b71c473c8a298f764501a3bb/users/9fdc234b79d0464e8d038f9edba96e90/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.816066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f70a1-e4ae-4b53-bc4c-15f0e750da00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35afd9a6b71c473c8a298f764501a3bb, user_id=9fdc234b79d0464e8d038f9edba96e90, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:05.819037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f70a1-e4ae-4b53-bc4c-15f0e750da00 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:05.887551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 916/1804] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:05.888744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:05.934797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 889/1805] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:05 2022] PUT /identity/v3/projects/35afd9a6b71c473c8a298f764501a3bb/users/9fdc234b79d0464e8d038f9edba96e90/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:05.946440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:05.946891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:05.947181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:05.991091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa496-607d-4f05-b312-aee045783934 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.012913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] MFA Rules not processed for user `9fdc234b79d0464e8d038f9edba96e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:06.017336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:06.127365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.128138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.128434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.128667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.129421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.131478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.183909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 890/1806] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:06.183909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.189734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540dc28-3920-4e9f-a9d5-080349124dad None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.195914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.196712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.197021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.197371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.199303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.201403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.304236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 917/1807] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:05 2022] POST /identity/v3/users => generated 292 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:06.305462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.316383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9182740-73bc-407a-b8f8-9fb25e76fbd2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.321046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.321708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.321987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.322293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.323944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.325537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.336332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 918/1808] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:06.340425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.350446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75cce0-fd8d-4ac4-b391-32eb8742dcd2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.355660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.356552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.356833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.357109 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] PATH_INFO: `/v3/projects/50a20951066943568d2163160839b886/users/ea59d48e754b4a919be1145c07a1c025/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.372724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a20951066943568d2163160839b886, user_id=ea59d48e754b4a919be1145c07a1c025, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.375536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.401170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 891/1809] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:06 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:06.406273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.499559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2477f3-e6cd-42c3-b5f2-296e1e3a0717 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.500006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 919/1810] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:06 2022] PUT /identity/v3/projects/50a20951066943568d2163160839b886/users/ea59d48e754b4a919be1145c07a1c025/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:06.508045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.587585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.588516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.589033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.589481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.590243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.592209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.641774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74036-bca3-41f1-a417-785e5ade5a66 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.646650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.647318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.647613 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.647878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.648605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.651973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.660616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 920/1811] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:06.664738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.676890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523ec9e-03ae-4d93-b3be-a61449e1f4e4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.683022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb052-bd77-4184-92eb-dcf7b0edd120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.683725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb052-bd77-4184-92eb-dcf7b0edd120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.684851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb052-bd77-4184-92eb-dcf7b0edd120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.684999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb052-bd77-4184-92eb-dcf7b0edd120 admin admin] PATH_INFO: `/v3/projects/50a20951066943568d2163160839b886/users/ea59d48e754b4a919be1145c07a1c025/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.687663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb052-bd77-4184-92eb-dcf7b0edd120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a20951066943568d2163160839b886, user_id=ea59d48e754b4a919be1145c07a1c025, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.692721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb052-bd77-4184-92eb-dcf7b0edd120 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.711605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 921/1812] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:06 2022] PUT /identity/v3/projects/50a20951066943568d2163160839b886/users/ea59d48e754b4a919be1145c07a1c025/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:06.723362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 892/1813] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:06 2022] POST /identity/v3/users => generated 295 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:06.724469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.724469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.724469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.727357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.738937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0bd30-7163-43dc-9b89-5ccd3b3a0850 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.760081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] MFA Rules not processed for user `ea59d48e754b4a919be1145c07a1c025`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:06.761601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:06.872671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 922/1814] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:06.892923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.894530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:06.935363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.936060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.936519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.936844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.937599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:06.939681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:06.970463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 893/1815] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:06.971563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:06.974198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca219f-388c-4fac-b7d7-c105999a8efd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.980025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:06.981647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:06.982269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:06.982698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:06.997480 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000ddcc-4c05-4883-a891-7c167ce86d60 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:06.999743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:07.001300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:07.003811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:07.005114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:07.005701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:07.006257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] PATH_INFO: `/v3/projects/f6e0270757e747359e2e248a893c9ca9/users/98d28cdffb8b400b80f93936bd422452/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:07.014634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 923/1816] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:07.032495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e0270757e747359e2e248a893c9ca9, user_id=98d28cdffb8b400b80f93936bd422452, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:07.036945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:07.177873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 894/1817] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:06 2022] PUT /identity/v3/projects/f6e0270757e747359e2e248a893c9ca9/users/98d28cdffb8b400b80f93936bd422452/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:07.181771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:07.192515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418ff1d-66b8-4d3b-b4ee-9871587d83e9 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:07.263580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dcb6f-cd4c-4baa-877c-e10560bc5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:07.264471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcb6f-cd4c-4baa-877c-e10560bc5a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:07.264872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcb6f-cd4c-4baa-877c-e10560bc5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:07.265243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcb6f-cd4c-4baa-877c-e10560bc5a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:07.266083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0dcb6f-cd4c-4baa-877c-e10560bc5a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:07.267937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0dcb6f-cd4c-4baa-877c-e10560bc5a4e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:07.283077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 924/1818] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:07.289819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:07.302035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15ff3-7f47-4b89-a73d-9bc25187063c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:07.308212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:07.313099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:07.313099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:07.313099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] PATH_INFO: `/v3/projects/f6e0270757e747359e2e248a893c9ca9/users/98d28cdffb8b400b80f93936bd422452/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:07.313099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e0270757e747359e2e248a893c9ca9, user_id=98d28cdffb8b400b80f93936bd422452, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:07.315438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:07.328387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 895/1819] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:07 2022] PUT /identity/v3/projects/f6e0270757e747359e2e248a893c9ca9/users/98d28cdffb8b400b80f93936bd422452/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:07.341003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:07.341568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:07.341945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:07.372827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] MFA Rules not processed for user `98d28cdffb8b400b80f93936bd422452`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:07.374172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:07.457899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 925/1820] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:07.491449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:07.493711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:07.558142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911017ea-5ee6-47a0-a128-4eb1100226cb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:07.562025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:07.562701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:07.562980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:07.563250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:07.573395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:07.574957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:07.585423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 896/1821] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:07.930175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:07.947998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480eb7-cec7-4380-85a8-84880e769bd8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:07.953140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1875f-8daa-45b3-9a88-c4bdd9a9e075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:07.954653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1875f-8daa-45b3-9a88-c4bdd9a9e075 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:07.955233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1875f-8daa-45b3-9a88-c4bdd9a9e075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:07.955691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1875f-8daa-45b3-9a88-c4bdd9a9e075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:08.029637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1875f-8daa-45b3-9a88-c4bdd9a9e075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:08.030820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1875f-8daa-45b3-9a88-c4bdd9a9e075 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:08.041113 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 926/1822] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:08.225269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:08.227026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:08.300747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c622fd-e083-4870-89cc-ca1bb84fd6ca service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:08.307670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:08.309042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:08.309334 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:08.309696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] PATH_INFO: `/v3/users/cfb045f163c84ac48694ef931de56e4f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:08.311232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb045f163c84ac48694ef931de56e4f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:08.314003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:08.553863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb045f163c84ac48694ef931de56e4f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:08.554585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb045f163c84ac48694ef931de56e4f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:08.574395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb045f163c84ac48694ef931de56e4f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:08.608465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb045f163c84ac48694ef931de56e4f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:08.609249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb045f163c84ac48694ef931de56e4f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:08.669379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 897/1823] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:08 2022] DELETE /identity/v3/users/cfb045f163c84ac48694ef931de56e4f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:08.674093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:08.674411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:08.674940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:08.706268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:08.709026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:08.804997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 927/1824] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:08.815174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:08.817325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:08.948297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695a5d-dfbd-4daa-aeb6-509905c56ea0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:08.953693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8d81-ec26-4c51-bab6-e253808cbe92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:08.954617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8d81-ec26-4c51-bab6-e253808cbe92 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:08.954927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8d81-ec26-4c51-bab6-e253808cbe92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:08.955210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8d81-ec26-4c51-bab6-e253808cbe92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:08.970575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c8d81-ec26-4c51-bab6-e253808cbe92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:08.972041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c8d81-ec26-4c51-bab6-e253808cbe92 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:08.985567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 898/1825] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:09.065108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:09.069101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:09.088864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb2e30-405e-469d-a41a-c067c275ab82 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:09.097037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:09.098308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.099031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.099481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] PATH_INFO: `/v3/users/21212a2d8d4945fb9a4d669f88c5d3f2` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:09.101491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21212a2d8d4945fb9a4d669f88c5d3f2)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:09.105337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:09.211248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ddcd4-32fa-454a-a347-82d7f009ec40 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.211576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ddcd4-32fa-454a-a347-82d7f009ec40 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.212130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ddcd4-32fa-454a-a347-82d7f009ec40 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:09.213830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 899/1826] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:19:09.225827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.226232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.226603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:09.246835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:09.248164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:09.332035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 900/1827] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:19:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:09.408238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21212a2d8d4945fb9a4d669f88c5d3f2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.409173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:09.412453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:09.441298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2b99-5dea-4a1f-87f5-36d3f108957b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:09.457883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2d8d8-2faa-4ae5-ab23-f9c62e6c7f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:09.458720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d8d8-2faa-4ae5-ab23-f9c62e6c7f78 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.459509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d8d8-2faa-4ae5-ab23-f9c62e6c7f78 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.459509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2d8d8-2faa-4ae5-ab23-f9c62e6c7f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:09.469092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2d8d8-2faa-4ae5-ab23-f9c62e6c7f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:09.470863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2d8d8-2faa-4ae5-ab23-f9c62e6c7f78 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:09.490322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 901/1828] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:09.515738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21212a2d8d4945fb9a4d669f88c5d3f2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.522786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21212a2d8d4945fb9a4d669f88c5d3f2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.536813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21212a2d8d4945fb9a4d669f88c5d3f2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.538748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21212a2d8d4945fb9a4d669f88c5d3f2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.545979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 928/1829] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:09 2022] DELETE /identity/v3/users/21212a2d8d4945fb9a4d669f88c5d3f2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:09.551515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.551928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.552297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:09.570901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:09.577429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:09.586278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:09.587679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:09.719093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831fa00-f6de-4714-80c7-a49bf54f2c35 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:09.732087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:09.733140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.733541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.733830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] PATH_INFO: `/v3/projects/7f8de5ebbf6a443aa462862327c6c080` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:09.735808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8de5ebbf6a443aa462862327c6c080)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:09.738346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:09.753122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 902/1830] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:09.767238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:09.770498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:09.903196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fbe44-8473-4b31-a959-882f3f8563d7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:09.920407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8de5ebbf6a443aa462862327c6c080', 'request_id': 'req-fae96586-1840-4843-87e6-204d96d15c56'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.933369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8de5ebbf6a443aa462862327c6c080', 'request_id': 'req-fae96586-1840-4843-87e6-204d96d15c56'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:09.978195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:09.979401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:09.979870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:09.980339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:10.029208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8de5ebbf6a443aa462862327c6c080', 'request_id': 'req-fae96586-1840-4843-87e6-204d96d15c56'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.042897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] The token cache is being invalidate because project 7f8de5ebbf6a443aa462862327c6c080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:10.043186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.044012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.046706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 929/1831] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:09 2022] DELETE /identity/v3/projects/7f8de5ebbf6a443aa462862327c6c080 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:10.051660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:10.053017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:10.060061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:10.061516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:10.065904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae96586-1840-4843-87e6-204d96d15c56 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:10.071047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:10.071947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:10.072229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:10.072521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] PATH_INFO: `/v3/users/6a4bf82f7e324584a8692c2ce35b7bce` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:10.073524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 903/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:10.073739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4bf82f7e324584a8692c2ce35b7bce)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:10.075707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:10.382968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4bf82f7e324584a8692c2ce35b7bce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.469394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4bf82f7e324584a8692c2ce35b7bce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.478396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4bf82f7e324584a8692c2ce35b7bce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.500011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4bf82f7e324584a8692c2ce35b7bce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.501250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4bf82f7e324584a8692c2ce35b7bce'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.513817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 930/1833] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:10 2022] DELETE /identity/v3/users/6a4bf82f7e324584a8692c2ce35b7bce => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:10.660195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:10.663230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:10.685778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac046c7-514f-45a6-8fab-e745956ece5f service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:10.777821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:10.778917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:10.779201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:10.779475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] PATH_INFO: `/v3/projects/c0a3077ce7274f8b936b64cc3a6fc0b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:10.780751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a3077ce7274f8b936b64cc3a6fc0b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:10.782791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:10.958500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a3077ce7274f8b936b64cc3a6fc0b6', 'request_id': 'req-07b6c4f6-b05d-4bb4-a117-20923a6d3346'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:10.966014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a3077ce7274f8b936b64cc3a6fc0b6', 'request_id': 'req-07b6c4f6-b05d-4bb4-a117-20923a6d3346'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.050174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a3077ce7274f8b936b64cc3a6fc0b6', 'request_id': 'req-07b6c4f6-b05d-4bb4-a117-20923a6d3346'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.068776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] The token cache is being invalidate because project c0a3077ce7274f8b936b64cc3a6fc0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:11.069227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.070330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.072548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 904/1834] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:10 2022] DELETE /identity/v3/projects/c0a3077ce7274f8b936b64cc3a6fc0b6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:11.077207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:11.078865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:11.094143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbe24c-6bbd-488a-8a88-fa8a19aabf52 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:11.168825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:11.170328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:11.170691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:11.170971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] PATH_INFO: `/v3/users/ea59d48e754b4a919be1145c07a1c025` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:11.172776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea59d48e754b4a919be1145c07a1c025)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:11.178195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:11.292293 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:11.294160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:11.312868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c4f6-b05d-4bb4-a117-20923a6d3346 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:11.319512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:11.321005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:11.321543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:11.322852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] PATH_INFO: `/v3/projects/22cd0ad7467949809041c5e9c0c3d172` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:11.324392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cd0ad7467949809041c5e9c0c3d172)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:11.326705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:11.409537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea59d48e754b4a919be1145c07a1c025'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.469856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cd0ad7467949809041c5e9c0c3d172', 'request_id': 'req-13841f60-496e-452d-8f75-80523093ec5d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.483586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea59d48e754b4a919be1145c07a1c025'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.491230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cd0ad7467949809041c5e9c0c3d172', 'request_id': 'req-13841f60-496e-452d-8f75-80523093ec5d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.509823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea59d48e754b4a919be1145c07a1c025'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.535438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea59d48e754b4a919be1145c07a1c025'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.536407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0ef0fe72-2bef-46c5-8aa8-208d8dc0650d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea59d48e754b4a919be1145c07a1c025'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.545192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 931/1835] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:11 2022] DELETE /identity/v3/users/ea59d48e754b4a919be1145c07a1c025 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:11.577975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cd0ad7467949809041c5e9c0c3d172', 'request_id': 'req-13841f60-496e-452d-8f75-80523093ec5d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.591934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] The token cache is being invalidate because project 22cd0ad7467949809041c5e9c0c3d172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:11.592461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.593265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-13841f60-496e-452d-8f75-80523093ec5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:11.594971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 905/1836] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:11 2022] DELETE /identity/v3/projects/22cd0ad7467949809041c5e9c0c3d172 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:11.600003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:11.600416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:11.600782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:11.623209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:11.624441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:11.687162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 932/1837] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:11.695365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:11.695816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:11.696176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:11.716654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:11.718196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:11.726824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 906/1838] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:11.731747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:11.742246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88d98-619b-4f1f-9d4a-ae7e8e6e9007 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:11.748273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:11.748970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:11.749259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:11.749591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:11.750533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:11.750890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:11.752694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:11.768982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 933/1839] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:11.778965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:11.793695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e2c68-eac6-4a1c-94da-e094c597ff8f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:11.798683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:11.799460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:11.799743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:11.800047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:11.800732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:11.802786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:11.965600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 907/1840] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:11 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:11.969935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:11.980920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9910cd-df06-48fc-89e6-1dd92575cbab admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.041193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.042513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.043025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.043312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.044051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.046346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.048584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.057628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:12.067713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538a5cd-09f7-41b8-8d61-6108639ec0b6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.073471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.074381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.074599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.074879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] PATH_INFO: `/v3/projects/50a20951066943568d2163160839b886` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.076173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a20951066943568d2163160839b886)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.078124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.181371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 934/1841] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:11 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:12.183168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.193581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7434ba-bbae-451b-99a5-af90be87a3a9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.199561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.206773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.206773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.206773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.206773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.206773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.217655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 935/1842] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:12.222675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.234913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a20951066943568d2163160839b886', 'request_id': 'req-74beaf8a-5a9a-44b8-841e-406b1ef2a935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:12.241104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6782fa3-1c58-4358-acd0-c58e7459d37b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.243211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a20951066943568d2163160839b886', 'request_id': 'req-74beaf8a-5a9a-44b8-841e-406b1ef2a935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:12.321530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.322385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.323432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.324020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.325026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.326802 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.341506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 936/1843] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:12.343871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a20951066943568d2163160839b886', 'request_id': 'req-74beaf8a-5a9a-44b8-841e-406b1ef2a935'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:12.346094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.363300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] The token cache is being invalidate because project 50a20951066943568d2163160839b886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:12.364023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:12.365870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-74beaf8a-5a9a-44b8-841e-406b1ef2a935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:12.366985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e334e7-9741-4302-aeca-415fe09d4da7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.372764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 908/1844] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:12 2022] DELETE /identity/v3/projects/50a20951066943568d2163160839b886 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:12.374705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464634-d850-4800-a6c4-05ded8e58d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.375909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464634-d850-4800-a6c4-05ded8e58d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.376365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464634-d850-4800-a6c4-05ded8e58d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.376556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ebc5-183a-4fac-af26-43ca5707df5e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.376766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ebc5-183a-4fac-af26-43ca5707df5e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.377048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267ebc5-183a-4fac-af26-43ca5707df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.377168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464634-d850-4800-a6c4-05ded8e58d7b admin admin] PATH_INFO: `/v3/projects/2f918910f4b64f17a14bdcf214906d4b/users/128dd1b1bb114c1caed29db2367aa8e1/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.397855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35464634-d850-4800-a6c4-05ded8e58d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f918910f4b64f17a14bdcf214906d4b, user_id=128dd1b1bb114c1caed29db2367aa8e1, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.401385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35464634-d850-4800-a6c4-05ded8e58d7b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.431455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0267ebc5-183a-4fac-af26-43ca5707df5e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:12.432780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0267ebc5-183a-4fac-af26-43ca5707df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:12.441351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 909/1845] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:12.449933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.450425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.450704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.469636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:12.470931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:12.479567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 910/1846] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:12.483843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.492938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b29b8-5242-4b24-addc-3610ab4cc412 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.499095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.499765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.500052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.500481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.501435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:12.501599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.503238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.515431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 911/1847] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:19:12.519902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.531644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a0c65-dbd3-4f7b-a6e4-1da64a68a3cd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.535042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 937/1848] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:12 2022] PUT /identity/v3/projects/2f918910f4b64f17a14bdcf214906d4b/users/128dd1b1bb114c1caed29db2367aa8e1/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:12.562472 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.563561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.563851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.614887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.616052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.616052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.616252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.624998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] MFA Rules not processed for user `128dd1b1bb114c1caed29db2367aa8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:12.627958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.628131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:12.629585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.724142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 938/1849] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:12.733352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.735478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:12.739465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 912/1850] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:12 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:12.741563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.769833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c30f3a-cf94-4886-b726-9ad8263818c7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.842819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9489a1-aafc-42f0-99bb-266fcf2c1bfe admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.849102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.851611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.851611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.851611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.851964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.854962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.871314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.872835 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.879003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.879003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.879003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.879003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.943641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 913/1851] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:12 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:12.948447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.958914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413247-60bf-4da7-bfb2-6112612ed10a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:12.964025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:12.964782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:12.965154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:12.965498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:12.966338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:12.968017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:12.984885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 914/1852] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:12.989811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:12.997949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 939/1853] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:12 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:13.003956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.016168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9420449-bcdc-40f8-a203-d1eed3afba11 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.095851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a598e-50c3-4d54-9fca-0118c5e2305c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.098262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.098952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.099232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.099506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.100235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.100499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.101174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.101454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.101741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.102192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.102469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.104796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.115963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 915/1854] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:13.120549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.131736 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b16f-dcfa-4637-9710-ed79dd441b79 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.138908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267eca2-4be0-4da3-ae4c-bc97a8827036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.140360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267eca2-4be0-4da3-ae4c-bc97a8827036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.140360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267eca2-4be0-4da3-ae4c-bc97a8827036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.140828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267eca2-4be0-4da3-ae4c-bc97a8827036 admin admin] PATH_INFO: `/v3/projects/fe79b20327b349dc9d55ed3c72eb3d25/users/dcd131c4c6d040c894d134f5ab444afd/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.162850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267eca2-4be0-4da3-ae4c-bc97a8827036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe79b20327b349dc9d55ed3c72eb3d25, user_id=dcd131c4c6d040c894d134f5ab444afd, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.165557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267eca2-4be0-4da3-ae4c-bc97a8827036 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.204945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 940/1855] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:13 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:13.206249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.217111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc48aa-356a-432e-882b-a157c1ff5c5e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.222511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.223295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.223583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.223866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.224643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.226373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.237601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 941/1856] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:13.249771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.260334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57d3b-d330-4b6f-82ab-4c07f7e66f44 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.265432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.266401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.266679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.266955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] PATH_INFO: `/v3/projects/0bfab67868434d799eb553e2b8fa06f7/users/e427d4ddef7e4bd39ac2ad69fd19681e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.274368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 916/1857] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:13 2022] PUT /identity/v3/projects/fe79b20327b349dc9d55ed3c72eb3d25/users/dcd131c4c6d040c894d134f5ab444afd/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:13.283547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfab67868434d799eb553e2b8fa06f7, user_id=e427d4ddef7e4bd39ac2ad69fd19681e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.286259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.288240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.288536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.292058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.317178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] MFA Rules not processed for user `dcd131c4c6d040c894d134f5ab444afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:13.318481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:13.385956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 917/1858] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:13.388331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.389416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 942/1859] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:13 2022] PUT /identity/v3/projects/0bfab67868434d799eb553e2b8fa06f7/users/e427d4ddef7e4bd39ac2ad69fd19681e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:13.393145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.503860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafee1d-b32a-46f4-80eb-48fcd93dc3d4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.530153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcde3c-92fb-4215-a2ca-f5ba0d03d7c1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.542092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.543601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.544331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.544860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.545950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.548955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.568765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 943/1860] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:13.574637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.588542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6e50-a7e5-4d8b-b193-dc02dd403ceb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.594723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc94a5-12dc-4109-bdec-c6d8e85ab6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.595763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc94a5-12dc-4109-bdec-c6d8e85ab6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.598012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc94a5-12dc-4109-bdec-c6d8e85ab6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.598012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc94a5-12dc-4109-bdec-c6d8e85ab6fe admin admin] PATH_INFO: `/v3/projects/0bfab67868434d799eb553e2b8fa06f7/users/e427d4ddef7e4bd39ac2ad69fd19681e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.598226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.598226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.598428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.598574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc94a5-12dc-4109-bdec-c6d8e85ab6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfab67868434d799eb553e2b8fa06f7, user_id=e427d4ddef7e4bd39ac2ad69fd19681e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.599301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.599514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.601640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc94a5-12dc-4109-bdec-c6d8e85ab6fe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.602723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.615265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 944/1861] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:13 2022] PUT /identity/v3/projects/0bfab67868434d799eb553e2b8fa06f7/users/e427d4ddef7e4bd39ac2ad69fd19681e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:13.626033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.626482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.627918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.667059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] MFA Rules not processed for user `e427d4ddef7e4bd39ac2ad69fd19681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:13.668481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:13.751216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 945/1862] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:13.762677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.764176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:13.824945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57e99-86df-4a5e-ac4a-d06419b6eac8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.825943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 918/1863] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:13 2022] POST /identity/v3/projects => generated 363 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:13.828733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.829624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.829988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.830242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.830421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.842427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.843998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.854626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 946/1864] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:13.931687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b464-c6f1-45b9-89bc-55d6d5302cc4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:13.931687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:13.931687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:13.931687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:13.932741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:13.933504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:13.936213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:13.981544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:13.992157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014614e-63df-46fa-9a79-566da20404a8 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:14.052959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 919/1865] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:13 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:14.054135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:14.055473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:14.056177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.056460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.056744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.065466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556bbdb-9739-43f2-bc0e-2ec4e968cbb0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:14.070443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:14.071114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.071444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.071730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.072673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:14.074411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:14.085041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 920/1866] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:14.089186 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:14.099689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f80a8-0edd-4cf8-91c0-b85e9fb1fe01 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:14.105056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:14.105993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.106305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.106581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] PATH_INFO: `/v3/projects/c05c2a070a0441318df601963639a0f8/users/d1e2e92ee71b4bcaaa596b86610a525e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.116481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:14.117936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:14.123986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05c2a070a0441318df601963639a0f8, user_id=d1e2e92ee71b4bcaaa596b86610a525e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:14.126677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:14.128379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 947/1867] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:14.207484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 921/1868] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:14 2022] PUT /identity/v3/projects/c05c2a070a0441318df601963639a0f8/users/d1e2e92ee71b4bcaaa596b86610a525e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:14.212728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:14.225803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3bd8f-7315-4db1-b736-0222a2b62f63 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:14.288181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd0e67-481a-46d8-9d34-b1a2c53c8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:14.288897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd0e67-481a-46d8-9d34-b1a2c53c8aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.289151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd0e67-481a-46d8-9d34-b1a2c53c8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.289428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd0e67-481a-46d8-9d34-b1a2c53c8aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.290196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd0e67-481a-46d8-9d34-b1a2c53c8aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:14.292345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd0e67-481a-46d8-9d34-b1a2c53c8aa3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:14.302754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 948/1869] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:14.307550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:14.317896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b620-1dd7-425d-b64e-5ca02726c0f9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:14.322606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:14.323504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.323776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.324045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] PATH_INFO: `/v3/projects/c05c2a070a0441318df601963639a0f8/users/d1e2e92ee71b4bcaaa596b86610a525e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.326019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05c2a070a0441318df601963639a0f8, user_id=d1e2e92ee71b4bcaaa596b86610a525e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:14.328738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:14.341310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 922/1870] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:14 2022] PUT /identity/v3/projects/c05c2a070a0441318df601963639a0f8/users/d1e2e92ee71b4bcaaa596b86610a525e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:14.351671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.351960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.352244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.380520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] MFA Rules not processed for user `d1e2e92ee71b4bcaaa596b86610a525e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:14.381724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:14.452864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 949/1871] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:14.464306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:14.465963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:14.524234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb8a1-040b-4714-aa89-357a842404a8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:14.528590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f6fa-d433-4acf-b6e1-31679e338dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:14.529287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f6fa-d433-4acf-b6e1-31679e338dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:14.529566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f6fa-d433-4acf-b6e1-31679e338dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:14.529837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f6fa-d433-4acf-b6e1-31679e338dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:14.540440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f6fa-d433-4acf-b6e1-31679e338dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:14.541997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f6fa-d433-4acf-b6e1-31679e338dbc service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:14.552564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 923/1872] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:15.646221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:15.720878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fbdd-4ece-41dc-af75-2032a40b40bd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:15.725435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:15.726372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:15.726652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:15.726926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] PATH_INFO: `/v3/users/dcd131c4c6d040c894d134f5ab444afd` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:15.728146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd131c4c6d040c894d134f5ab444afd)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:15.730609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:16.079043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd131c4c6d040c894d134f5ab444afd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:16.177670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd131c4c6d040c894d134f5ab444afd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:16.186363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd131c4c6d040c894d134f5ab444afd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:16.198959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd131c4c6d040c894d134f5ab444afd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:16.199769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd131c4c6d040c894d134f5ab444afd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:16.205943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 950/1873] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:15 2022] DELETE /identity/v3/users/dcd131c4c6d040c894d134f5ab444afd => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:16.210608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:16.211057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:16.211184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:16.229373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:16.230671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:16.316746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 924/1874] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:16.327096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:16.328538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:16.400469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a83b9-e405-47c6-b4d2-17a06f9240f9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:16.404853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:16.405582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:16.405865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:16.406218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:16.415520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:16.418092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:16.427895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 951/1875] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:16.912213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:16.912213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:16.926925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf1578-9e6e-41fd-b398-99603d7da253 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:16.932588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:16.933518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:16.934251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:16.934251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] PATH_INFO: `/v3/projects/fe79b20327b349dc9d55ed3c72eb3d25` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:16.935537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe79b20327b349dc9d55ed3c72eb3d25)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:16.937613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:17.090313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe79b20327b349dc9d55ed3c72eb3d25', 'request_id': 'req-c6093127-05dd-477d-9fc4-f2a615ea72e8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.096665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe79b20327b349dc9d55ed3c72eb3d25', 'request_id': 'req-c6093127-05dd-477d-9fc4-f2a615ea72e8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.160645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe79b20327b349dc9d55ed3c72eb3d25', 'request_id': 'req-c6093127-05dd-477d-9fc4-f2a615ea72e8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.173365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] The token cache is being invalidate because project fe79b20327b349dc9d55ed3c72eb3d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:17.173513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.174227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.175959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 925/1876] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:16 2022] DELETE /identity/v3/projects/fe79b20327b349dc9d55ed3c72eb3d25 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:17.180054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:17.192005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a67b0-c8be-41fe-a52a-a193129aaf08 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:17.263464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:17.264366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:17.264651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:17.264967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] PATH_INFO: `/v3/users/d1e2e92ee71b4bcaaa596b86610a525e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:17.266355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e2e92ee71b4bcaaa596b86610a525e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:17.268361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:17.470664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e2e92ee71b4bcaaa596b86610a525e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.537163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e2e92ee71b4bcaaa596b86610a525e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.546049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e2e92ee71b4bcaaa596b86610a525e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.558816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e2e92ee71b4bcaaa596b86610a525e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.559646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a904d27a-5b98-46b0-8879-407413755295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e2e92ee71b4bcaaa596b86610a525e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:17.565641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 952/1877] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:17 2022] DELETE /identity/v3/users/d1e2e92ee71b4bcaaa596b86610a525e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:18.011164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.014441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:18.030982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6093127-05dd-477d-9fc4-f2a615ea72e8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.090008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.090897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.091174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.091450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] PATH_INFO: `/v3/projects/c05c2a070a0441318df601963639a0f8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.092646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05c2a070a0441318df601963639a0f8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.094568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:18.214637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05c2a070a0441318df601963639a0f8', 'request_id': 'req-12f7e5b4-437e-4aa1-baa7-841792057428'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:18.219777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05c2a070a0441318df601963639a0f8', 'request_id': 'req-12f7e5b4-437e-4aa1-baa7-841792057428'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:18.277844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05c2a070a0441318df601963639a0f8', 'request_id': 'req-12f7e5b4-437e-4aa1-baa7-841792057428'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:18.289096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] The token cache is being invalidate because project c05c2a070a0441318df601963639a0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:18.289382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:18.290073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-12f7e5b4-437e-4aa1-baa7-841792057428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:18.291697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 926/1878] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:18 2022] DELETE /identity/v3/projects/c05c2a070a0441318df601963639a0f8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:18.296590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.297036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.297140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.316509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:18.317689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:18.377296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 953/1879] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:18.386188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.386487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.386775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.409067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:18.409259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:18.419640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 927/1880] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:18.424658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.435907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b8023-80f8-4a96-b1c6-d6aeb7c9e36f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.441615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.442402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.442755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.443105 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.444521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:18.444901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.446798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:18.460804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 954/1881] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:18.465972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.481169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba976d5-2e7d-4f77-ad86-7ff8495dcc34 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.487400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.488087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.488395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.488679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.489487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.491496 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:18.590596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 928/1882] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:18 2022] POST /identity/v3/projects => generated 355 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:18.593648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.604338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fcd16-a413-471c-a241-a669babfd96a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.667155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.667839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.668122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.668400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.669200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.671289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:18.785431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 955/1883] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:18 2022] POST /identity/v3/users => generated 278 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:18.789892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.800317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8d937-635f-49aa-9a7e-5c5b29a64fe9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.804894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.805552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.805835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.806135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.807420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.808950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:18.819950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 929/1884] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:18.826658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.838934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b663e-bb32-4b8e-bbb1-55052fabbc4d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.846750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f03f8c-822f-47b1-8505-4e775df70dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.850966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03f8c-822f-47b1-8505-4e775df70dee admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.850966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03f8c-822f-47b1-8505-4e775df70dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.850966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f03f8c-822f-47b1-8505-4e775df70dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.850966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f03f8c-822f-47b1-8505-4e775df70dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.850966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f03f8c-822f-47b1-8505-4e775df70dee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:18.860976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 956/1885] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:18.865399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:18.876735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece2c2-2178-4832-8031-8d81599c8cac admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:18.885352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:18.885352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:18.885352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:18.885352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] PATH_INFO: `/v3/projects/c3e6750929a045588d64b61b0f7cf18f/users/150ea513cbe74681b789d49d06b9b48a/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:18.898205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e6750929a045588d64b61b0f7cf18f, user_id=150ea513cbe74681b789d49d06b9b48a, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:18.901402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:19.034879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 930/1886] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:18 2022] PUT /identity/v3/projects/c3e6750929a045588d64b61b0f7cf18f/users/150ea513cbe74681b789d49d06b9b48a/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:19.047136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:19.047469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:19.047787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:19.077509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] MFA Rules not processed for user `150ea513cbe74681b789d49d06b9b48a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:19.078819 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:19.144821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 957/1887] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:19.149499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:19.218757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39ddc9-b03f-4019-b20c-d73456b3c75a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:19.225210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:19.225877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:19.226178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:19.226456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:19.227146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:19.229310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:19.333183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 931/1888] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:19 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:19.337553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:19.351096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01010d-dee2-42de-8932-52571a5faf5e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:19.413983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:19.415518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:19.415820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:19.416453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:19.417298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:19.419426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:19.544532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 958/1889] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:19 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:19.547399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:19.564260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fab5a-0fdd-4a7f-bd12-56325a361dfe admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:19.573703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:19.574560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:19.575727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:19.575727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:19.576166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:19.579935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:19.593959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 932/1890] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:19.605151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:19.630501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d0fb-e0c6-452d-8d7e-c6159d7cdc01 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:19.635734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:19.637008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:19.637250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:19.637745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] PATH_INFO: `/v3/projects/c56cfac62eb24e6ca4650edb081e26ef/users/2de90534cb664128b13cc91138024ddf/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:19.681395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56cfac62eb24e6ca4650edb081e26ef, user_id=2de90534cb664128b13cc91138024ddf, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:19.685586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:19.825624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 959/1891] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:19 2022] PUT /identity/v3/projects/c56cfac62eb24e6ca4650edb081e26ef/users/2de90534cb664128b13cc91138024ddf/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:19.836634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:19.849383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b120e82-dfe7-4faf-9119-7b68f0858ee3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:19.947667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28f34a-1803-44d4-ad67-51ac1a9b5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:19.947667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f34a-1803-44d4-ad67-51ac1a9b5524 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:19.947667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f34a-1803-44d4-ad67-51ac1a9b5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:19.947667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f34a-1803-44d4-ad67-51ac1a9b5524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:19.948506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28f34a-1803-44d4-ad67-51ac1a9b5524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:19.950733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28f34a-1803-44d4-ad67-51ac1a9b5524 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:19.966039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 933/1892] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:19.971449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:19.992050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef87aa-61d6-4615-afec-a75353329512 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:19.999673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:20.001287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:20.002301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:20.003024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] PATH_INFO: `/v3/projects/c56cfac62eb24e6ca4650edb081e26ef/users/2de90534cb664128b13cc91138024ddf/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:20.006776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56cfac62eb24e6ca4650edb081e26ef, user_id=2de90534cb664128b13cc91138024ddf, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:20.012528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:20.028964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 960/1893] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:19 2022] PUT /identity/v3/projects/c56cfac62eb24e6ca4650edb081e26ef/users/2de90534cb664128b13cc91138024ddf/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:20.046073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:20.046823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:20.046823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:20.081363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] MFA Rules not processed for user `2de90534cb664128b13cc91138024ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:20.082613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:20.192403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 934/1894] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:20.234424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:20.236286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:20.339262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf3d35-2351-428a-92ba-c44e9beed9c8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:20.345477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:20.346427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:20.346808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:20.347199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:20.361447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:20.363197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:20.375552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 961/1895] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:20.831723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:20.833135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:20.846892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5766a-e639-468a-b0b5-4d32c0a521aa None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:20.857825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec4e45-84ab-45fa-a6f0-94621ba8d6d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:20.858916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec4e45-84ab-45fa-a6f0-94621ba8d6d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:20.859342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec4e45-84ab-45fa-a6f0-94621ba8d6d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:20.859754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec4e45-84ab-45fa-a6f0-94621ba8d6d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:20.962255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec4e45-84ab-45fa-a6f0-94621ba8d6d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:20.972899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec4e45-84ab-45fa-a6f0-94621ba8d6d0 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:20.975819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 935/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:22.236440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:22.238782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:22.314512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049002c4-90e1-4bdc-b2e0-7311ddf7090e service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:22.320794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:22.321852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:22.322233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:22.322846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] PATH_INFO: `/v3/users/128dd1b1bb114c1caed29db2367aa8e1` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:22.324367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=128dd1b1bb114c1caed29db2367aa8e1)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:22.327229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:22.685268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128dd1b1bb114c1caed29db2367aa8e1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:22.972585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128dd1b1bb114c1caed29db2367aa8e1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:22.981896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128dd1b1bb114c1caed29db2367aa8e1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:22.995715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128dd1b1bb114c1caed29db2367aa8e1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:22.997044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128dd1b1bb114c1caed29db2367aa8e1'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:23.016412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 962/1897] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:22 2022] DELETE /identity/v3/users/128dd1b1bb114c1caed29db2367aa8e1 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:23.018655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:23.019129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:23.019261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:23.048943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:23.048943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:23.136505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 936/1898] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:23.146160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:23.148792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:23.217168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3b36-7383-4e5e-a6b4-bfca43da7b14 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:23.221932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:23.222637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:23.222932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:23.223213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:23.234349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:23.235859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:23.248412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 963/1899] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:25.284318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:25.284318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:25.309880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826782f-7c52-4494-b6eb-34dbebfa2ff1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:25.324424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:25.324424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:25.324424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:25.324424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] PATH_INFO: `/v3/projects/2f918910f4b64f17a14bdcf214906d4b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:25.324745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f918910f4b64f17a14bdcf214906d4b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:25.325148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:25.582336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f918910f4b64f17a14bdcf214906d4b', 'request_id': 'req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:25.599033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f918910f4b64f17a14bdcf214906d4b', 'request_id': 'req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:25.705201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f918910f4b64f17a14bdcf214906d4b', 'request_id': 'req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:25.722580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] The token cache is being invalidate because project 2f918910f4b64f17a14bdcf214906d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:25.722870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:25.723631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:25.725582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 937/1900] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:25 2022] DELETE /identity/v3/projects/2f918910f4b64f17a14bdcf214906d4b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:25.730304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:25.742334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadfb35-9adc-4ab6-a298-be01e4adfce0 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:25.810787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:25.811998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:25.812478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:25.812870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] PATH_INFO: `/v3/users/e427d4ddef7e4bd39ac2ad69fd19681e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:25.815088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e427d4ddef7e4bd39ac2ad69fd19681e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:25.817341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:26.116499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e427d4ddef7e4bd39ac2ad69fd19681e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:26.211700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e427d4ddef7e4bd39ac2ad69fd19681e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:26.219686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e427d4ddef7e4bd39ac2ad69fd19681e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:26.237178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e427d4ddef7e4bd39ac2ad69fd19681e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:26.238059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44b259e6-c8c1-4c61-a125-6cf586d207fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e427d4ddef7e4bd39ac2ad69fd19681e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:26.246428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 964/1901] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:25 2022] DELETE /identity/v3/users/e427d4ddef7e4bd39ac2ad69fd19681e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:26.749085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:26.750703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:26.773368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e4aa-b270-44e9-897a-2fcbbf620c9c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:26.865078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:26.867133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:26.867430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:26.867746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] PATH_INFO: `/v3/projects/0bfab67868434d799eb553e2b8fa06f7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:26.871254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bfab67868434d799eb553e2b8fa06f7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:26.873339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:26.989137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bfab67868434d799eb553e2b8fa06f7', 'request_id': 'req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:26.995733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bfab67868434d799eb553e2b8fa06f7', 'request_id': 'req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:27.068908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bfab67868434d799eb553e2b8fa06f7', 'request_id': 'req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:27.081287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] The token cache is being invalidate because project 0bfab67868434d799eb553e2b8fa06f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:27.081731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:27.082442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-82a957b8-a2c0-4b9f-b2a9-d2308fdcf190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:27.084026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 938/1902] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:26 2022] DELETE /identity/v3/projects/0bfab67868434d799eb553e2b8fa06f7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:27.089768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.090526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.090526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.114584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:27.116574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:27.218889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 965/1903] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:27.232650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.232650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.232650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.259595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:27.261786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:27.272654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 939/1904] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:27.277629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.293729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79b002-7680-413f-b5bc-ea2c59652c47 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.300696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.301383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.301713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.302785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.303544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:27.303907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.305769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:27.322177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 966/1905] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:27.324542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.335020 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568aebe-fc01-48da-880a-b0fa53e31b19 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.341808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.342532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.345686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.345686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.345686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.345989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:27.477409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 940/1906] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:27 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:27.479766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.492258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df6b78-3e3c-4c18-99af-c39d7bd04a3f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.618930 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.620892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.621404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.634472 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.636012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.639303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:27.754509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 967/1907] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:27 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:27.757433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.772056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329606-6b21-4807-9a99-4c27578160d0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.780853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.782225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.782681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.783284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.784456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.786553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:27.805652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 941/1908] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:27.810494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.818368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.821449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:27.826284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bfa24-9d57-457d-8b53-690624aff4c8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.836885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.839323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.840258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.843201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.843949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.845578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:27.845703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c89f1-3b8f-4e78-930d-b2ac6c729d9e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.864991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.866326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.866775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.867203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] PATH_INFO: `/v3/users/9fdc234b79d0464e8d038f9edba96e90` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.870500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdc234b79d0464e8d038f9edba96e90)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.873828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:27.877722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 968/1909] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:27.881857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:27.897203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109c96-d4aa-4c43-8204-5089b22ad774 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:27.912761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e05749-f291-4066-a7a9-9ac0329312f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:27.914056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05749-f291-4066-a7a9-9ac0329312f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:27.914590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05749-f291-4066-a7a9-9ac0329312f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:27.915068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05749-f291-4066-a7a9-9ac0329312f9 admin admin] PATH_INFO: `/v3/projects/ae23666fa9c24ed5b3e0ecdfac1f4448/users/9c79d2a209184afdaaae8756e1695e83/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:27.941048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e05749-f291-4066-a7a9-9ac0329312f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae23666fa9c24ed5b3e0ecdfac1f4448, user_id=9c79d2a209184afdaaae8756e1695e83, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:27.943812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e05749-f291-4066-a7a9-9ac0329312f9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:28.080496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 969/1910] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:27 2022] PUT /identity/v3/projects/ae23666fa9c24ed5b3e0ecdfac1f4448/users/9c79d2a209184afdaaae8756e1695e83/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:28.092061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:28.092753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:28.092753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:28.154607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] MFA Rules not processed for user `9c79d2a209184afdaaae8756e1695e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:28.156194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:28.156312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdc234b79d0464e8d038f9edba96e90'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:28.157035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdc234b79d0464e8d038f9edba96e90'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:28.167148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdc234b79d0464e8d038f9edba96e90'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:28.182576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdc234b79d0464e8d038f9edba96e90'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:28.183508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e07f1b54-a982-4866-ba7d-320e3a614ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdc234b79d0464e8d038f9edba96e90'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:28.243432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 970/1911] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:28.248908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:28.250436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:28.265887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 942/1912] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:27 2022] DELETE /identity/v3/users/9fdc234b79d0464e8d038f9edba96e90 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:28.271155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:28.272236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:28.273102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:28.305226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:28.306502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:28.348085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac86ea-cf13-4627-b14f-6b7d851a26c7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:28.417277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 943/1913] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:28.430672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:28.433633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:28.443949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:28.443949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:28.443949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:28.443949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:28.444245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:28.446153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:28.530850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec5cc-c1b0-497a-b549-95c642f98dcc None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:28.534543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:28.535202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:28.535515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:28.535807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:28.551684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:28.551684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:28.559109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 944/1914] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:28.574868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 971/1915] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:28 2022] POST /identity/v3/projects => generated 385 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:28.579070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:28.589723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085e612-f315-4c29-a8af-414b5aedc9a5 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:28.669565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:28.670583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:28.670868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:28.671143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:28.672193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:28.674297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.000355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 945/1916] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:28 2022] POST /identity/v3/users => generated 293 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:29.003443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.014759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b175e-96b2-40c8-94b0-197423cf76ae admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.019592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.020492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.020778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.021046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.021791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.023568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.036139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 972/1917] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:29.042570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.053166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa107-edbd-4a8a-9aa6-bef065efdd9a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.059379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.060279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.063692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.063692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.063692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.063692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.076415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 946/1918] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:29.080783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.098191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710d30-11dd-4abb-8245-37037e70f4ce admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.098944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90391d6-4d0d-4e63-8bf3-390514f24bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.099639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90391d6-4d0d-4e63-8bf3-390514f24bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.099924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90391d6-4d0d-4e63-8bf3-390514f24bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.100390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90391d6-4d0d-4e63-8bf3-390514f24bc3 admin admin] PATH_INFO: `/v3/projects/7dc3ec5ca3a44a1fb322ddb7afed6dff/users/683f426ed29e45988620aafd32f54a18/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.120097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90391d6-4d0d-4e63-8bf3-390514f24bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc3ec5ca3a44a1fb322ddb7afed6dff, user_id=683f426ed29e45988620aafd32f54a18, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.123612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90391d6-4d0d-4e63-8bf3-390514f24bc3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.182805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.184350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:29.203778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca2bd-d4f5-49b1-8e3d-532f43845aae admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.213263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.213263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.213263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.213263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] PATH_INFO: `/v3/projects/35afd9a6b71c473c8a298f764501a3bb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.214143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35afd9a6b71c473c8a298f764501a3bb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.214422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.247645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 973/1919] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:29 2022] PUT /identity/v3/projects/7dc3ec5ca3a44a1fb322ddb7afed6dff/users/683f426ed29e45988620aafd32f54a18/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:29.255989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.256529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.256928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.285842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] MFA Rules not processed for user `683f426ed29e45988620aafd32f54a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:29.287197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:29.380773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35afd9a6b71c473c8a298f764501a3bb', 'request_id': 'req-1ff2cd54-d61f-4ede-89f2-77d05598bb98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.394559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35afd9a6b71c473c8a298f764501a3bb', 'request_id': 'req-1ff2cd54-d61f-4ede-89f2-77d05598bb98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.410154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 974/1920] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:29.413642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.502693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4756f7-599d-4ea0-a57c-a962b0281b0c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.503280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35afd9a6b71c473c8a298f764501a3bb', 'request_id': 'req-1ff2cd54-d61f-4ede-89f2-77d05598bb98'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.515705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] The token cache is being invalidate because project 35afd9a6b71c473c8a298f764501a3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:29.515994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.516738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.521482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 947/1921] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:29 2022] DELETE /identity/v3/projects/35afd9a6b71c473c8a298f764501a3bb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:29.526631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.528165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:29.564926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.568342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.568342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.568342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.568342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.569880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.602994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2cd54-d61f-4ede-89f2-77d05598bb98 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.608542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.609411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.609693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.609987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] PATH_INFO: `/v3/users/98d28cdffb8b400b80f93936bd422452` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.611198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d28cdffb8b400b80f93936bd422452)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.613230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.671951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 975/1922] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:29 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:29.676124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.677902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:29.745999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3154c8-64a3-4267-851d-e8a98282f7e4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.750865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.751548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.751827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.752104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.752852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.754758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.893041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 976/1923] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:29 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:29.897522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.902553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d28cdffb8b400b80f93936bd422452'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.903335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d28cdffb8b400b80f93936bd422452'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.909229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab35489-f613-4d92-a3e9-cc1df344bb72 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.913781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d28cdffb8b400b80f93936bd422452'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.914963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.915775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.916129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.916564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.917440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.919111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:29.926857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d28cdffb8b400b80f93936bd422452'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.927574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d28cdffb8b400b80f93936bd422452'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:29.929467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 977/1924] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:29.934033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:29.936768 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:29.950054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1c3b3-2553-4055-8951-1700aa2d782f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:29.955753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:29.956646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:29.956927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:29.957200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] PATH_INFO: `/v3/projects/7cea1b168aad4a06ba451aefc1629ab7/users/24ebb070b835460a940700cadd864534/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:29.974497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cea1b168aad4a06ba451aefc1629ab7, user_id=24ebb070b835460a940700cadd864534, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:29.977135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:30.051850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 948/1925] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:29 2022] DELETE /identity/v3/users/98d28cdffb8b400b80f93936bd422452 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:30.074749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 978/1926] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:29 2022] PUT /identity/v3/projects/7cea1b168aad4a06ba451aefc1629ab7/users/24ebb070b835460a940700cadd864534/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:30.080723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:30.150142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff732fc-8cb1-4ad4-a174-f08b27131e15 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:30.217881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756912e-9f40-4ded-a62a-f85724bbda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:30.218907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756912e-9f40-4ded-a62a-f85724bbda82 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:30.219185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756912e-9f40-4ded-a62a-f85724bbda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:30.219462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756912e-9f40-4ded-a62a-f85724bbda82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:30.220203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756912e-9f40-4ded-a62a-f85724bbda82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:30.221812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756912e-9f40-4ded-a62a-f85724bbda82 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:30.233794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 949/1927] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:30.239284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:30.252384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752662cd-62d8-4bd7-b696-65bb724f7d53 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:30.257706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:30.259304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:30.259652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:30.260783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] PATH_INFO: `/v3/projects/7cea1b168aad4a06ba451aefc1629ab7/users/24ebb070b835460a940700cadd864534/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:30.262990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cea1b168aad4a06ba451aefc1629ab7, user_id=24ebb070b835460a940700cadd864534, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:30.265691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:30.276862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 979/1928] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:30 2022] PUT /identity/v3/projects/7cea1b168aad4a06ba451aefc1629ab7/users/24ebb070b835460a940700cadd864534/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:30.292413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:30.292699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:30.292979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:30.327587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] MFA Rules not processed for user `24ebb070b835460a940700cadd864534`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:30.329153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:30.449994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 950/1929] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:30.453776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:30.456726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:30.529437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daec43-65a3-48cb-8256-fc203a5a06ad admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:30.533365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:30.534503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:30.534503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:30.534689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:30.536338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:30.604755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:30.606222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6abe-6a78-44dd-bdf2-d310e5def70d service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:30.615293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 980/1930] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:30.622985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:30.630826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:30.705979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea3bed-035a-4b66-b8bd-d0bd862db841 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:30.711014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:30.711889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:30.712148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:30.712539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] PATH_INFO: `/v3/projects/f6e0270757e747359e2e248a893c9ca9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:30.714695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e0270757e747359e2e248a893c9ca9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:30.717070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:30.844010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e0270757e747359e2e248a893c9ca9', 'request_id': 'req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:30.850004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e0270757e747359e2e248a893c9ca9', 'request_id': 'req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:30.929109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e0270757e747359e2e248a893c9ca9', 'request_id': 'req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:30.942225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] The token cache is being invalidate because project f6e0270757e747359e2e248a893c9ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:30.942512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:30.946019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e8e3cfbe-01c8-406e-bbaa-65a4a1d328bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:30.946019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 951/1931] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:30 2022] DELETE /identity/v3/projects/f6e0270757e747359e2e248a893c9ca9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:30.955030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:30.957963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:30.957963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:30.974121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:30.975447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:31.046489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 981/1932] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:31.055956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.056445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.056582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.081390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:31.082521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:31.091060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 952/1933] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:31.095703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:31.106021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede4724-6aeb-4c2c-bd8e-6e1480dc9c8a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:31.110592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:31.111261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.111544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.111820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.112589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:31.112896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:31.114527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:31.127715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 982/1934] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:31.132749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:31.145049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9cd5-0a47-4eb4-9465-18af94d1d2b0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:31.152930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:31.153770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.154053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.154357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.155062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:31.156966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:31.295650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 953/1935] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:31 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:31.298345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:31.312961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d0407-4a5a-4725-a260-3c1a03261f0c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:31.412599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:31.413292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.413572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.413851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.414804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:31.417373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:31.547722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:31.547996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 983/1936] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:31 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:31.562455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d80f-c5e1-441e-a296-b0049538a151 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:31.574528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:31.575581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.576118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.576497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.577661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:31.583981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:31.607225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 954/1937] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:31.611446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:31.624928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdeb78-9f38-4189-b662-3721abafc49e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:31.629857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca0cd2-691d-45e9-969f-5d515e4e7ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:31.630617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca0cd2-691d-45e9-969f-5d515e4e7ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.631064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca0cd2-691d-45e9-969f-5d515e4e7ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.631348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca0cd2-691d-45e9-969f-5d515e4e7ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.632088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca0cd2-691d-45e9-969f-5d515e4e7ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:31.633686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca0cd2-691d-45e9-969f-5d515e4e7ff1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:31.644517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 984/1938] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:31.649035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:31.660948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb9d93-860f-4171-9225-ee65e0722a1d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:31.666008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:31.667628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.667910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.668184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] PATH_INFO: `/v3/projects/1161f53ddb0441fb992706e5f12903d9/users/a0ac76b045054e8699044297eb301cff/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.684568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1161f53ddb0441fb992706e5f12903d9, user_id=a0ac76b045054e8699044297eb301cff, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:31.687522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:31.804155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 955/1939] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:31 2022] PUT /identity/v3/projects/1161f53ddb0441fb992706e5f12903d9/users/a0ac76b045054e8699044297eb301cff/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:31.823764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:31.824164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:31.824425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:31.852372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] MFA Rules not processed for user `a0ac76b045054e8699044297eb301cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:31.853478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:31.927454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 985/1940] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:31.932246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.002674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20562-653c-45a4-80ec-acbbd21f9dda admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.008139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.008811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.009097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.009436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.010096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:32.012788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:32.120406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 956/1941] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:31 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:32.125683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.138653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e349a-5bae-44e0-ac54-1c5cc478e2ca None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.200215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.200843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.201314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.201618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.202372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:32.204432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:32.306998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 986/1942] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:32 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:32.311673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.324316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f15c-523f-4318-8512-e8e1cb69f893 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.328919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.329628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.329909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.330223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.330937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:32.332542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:32.344618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 957/1943] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:32.350947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.374601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c0e3-cd7a-4cac-afab-01478faaef07 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.380360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.383354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.383354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.383579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] PATH_INFO: `/v3/projects/53ffddf95c074c80b2a70e43cc6dd540/users/fc376ffe0bde4070998fd0ff642ca92f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.405341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ffddf95c074c80b2a70e43cc6dd540, user_id=fc376ffe0bde4070998fd0ff642ca92f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:32.408237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:32.565280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 987/1944] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:32 2022] PUT /identity/v3/projects/53ffddf95c074c80b2a70e43cc6dd540/users/fc376ffe0bde4070998fd0ff642ca92f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:32.570278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.589076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0c57-052a-422f-9d02-649baa0e0297 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.662775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8bca6-a307-4cb9-97a1-04a9b6771190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.663585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bca6-a307-4cb9-97a1-04a9b6771190 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.663825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bca6-a307-4cb9-97a1-04a9b6771190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.664490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bca6-a307-4cb9-97a1-04a9b6771190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.665582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8bca6-a307-4cb9-97a1-04a9b6771190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:32.668409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8bca6-a307-4cb9-97a1-04a9b6771190 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:32.681078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 958/1945] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:32.690609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.704180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc8e2f-c1bd-4821-bafe-1a2a22b735d3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.710018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.711141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.711426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.711703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] PATH_INFO: `/v3/projects/53ffddf95c074c80b2a70e43cc6dd540/users/fc376ffe0bde4070998fd0ff642ca92f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.715047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ffddf95c074c80b2a70e43cc6dd540, user_id=fc376ffe0bde4070998fd0ff642ca92f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:32.718272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:32.732393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 988/1946] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:32 2022] PUT /identity/v3/projects/53ffddf95c074c80b2a70e43cc6dd540/users/fc376ffe0bde4070998fd0ff642ca92f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:32.751794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.752090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.752536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.795807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] MFA Rules not processed for user `fc376ffe0bde4070998fd0ff642ca92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:32.797126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:32.904249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:32.906189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:32.922353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 959/1947] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:32.970980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057223b-8974-48f0-88e4-84be39774444 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:32.974770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:32.975442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:32.975720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:32.976120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:32.978018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:33.049563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:33.052814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:33.054298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:33.059927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:33.066765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 989/1948] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:33.069320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398226f0-d660-4277-a717-3b0124cc16e3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:33.072063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:33.073807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:33.074008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:33.074718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:33.075002 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:33.075454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:33.089008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:33.089672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:33.103617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 960/1949] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:33.150318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381329d-80bc-4d4e-b36d-7e9a5c701694 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:33.155823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:33.156706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:33.156982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:33.157251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] PATH_INFO: `/v3/users/127c376ff5424f22abcf42dfd1c0f85a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:33.158494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127c376ff5424f22abcf42dfd1c0f85a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:33.160519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:33.386194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127c376ff5424f22abcf42dfd1c0f85a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:33.472355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127c376ff5424f22abcf42dfd1c0f85a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:33.479859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127c376ff5424f22abcf42dfd1c0f85a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:33.494492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127c376ff5424f22abcf42dfd1c0f85a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:33.495259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127c376ff5424f22abcf42dfd1c0f85a'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:33.502149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 990/1950] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:33 2022] DELETE /identity/v3/users/127c376ff5424f22abcf42dfd1c0f85a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:33.602462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:33.612470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c51fd-011f-4d36-b7a2-eacef053fca4 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:33.685518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:33.686388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:33.687032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:33.687428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:33.689454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:33.754439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:33.755874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:33.765958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 961/1951] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:33.868096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:33.869765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:33.944517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38f90c-ebc3-4509-8dab-33bb8d17a3f2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:33.950877 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:33.951759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:33.952046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:33.952322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] PATH_INFO: `/v3/projects/da740006fa564f10a0abc89643fc1788` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:33.953686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da740006fa564f10a0abc89643fc1788)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:33.955644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:34.069741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da740006fa564f10a0abc89643fc1788', 'request_id': 'req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.076093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da740006fa564f10a0abc89643fc1788', 'request_id': 'req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.169483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da740006fa564f10a0abc89643fc1788', 'request_id': 'req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.181211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] The token cache is being invalidate because project da740006fa564f10a0abc89643fc1788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:34.181496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.182393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.184820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 991/1952] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:33 2022] DELETE /identity/v3/projects/da740006fa564f10a0abc89643fc1788 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:34.189009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:34.199785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae6fb-5070-4515-8785-45c98c688dd7 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:34.258254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:34.259107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:34.259404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:34.259812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] PATH_INFO: `/v3/users/2a1f84f903d245eab75c45adbc116c2e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:34.261074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1f84f903d245eab75c45adbc116c2e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:34.263205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:34.545499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1f84f903d245eab75c45adbc116c2e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.546196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1f84f903d245eab75c45adbc116c2e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.553651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1f84f903d245eab75c45adbc116c2e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.567222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1f84f903d245eab75c45adbc116c2e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.567955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c358e379-9d9f-4b38-bb86-b3fd8e6e28ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1f84f903d245eab75c45adbc116c2e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:34.653025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 962/1953] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:34 2022] DELETE /identity/v3/users/2a1f84f903d245eab75c45adbc116c2e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:34.957504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:34.959242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:34.974905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7d776-39b7-41d5-96ad-c5ed437bcb8b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.042549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.043573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.043917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.044326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] PATH_INFO: `/v3/projects/22a8ff779ed44023af0b817fdbba4077` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.045688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a8ff779ed44023af0b817fdbba4077)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.047716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:35.171135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a8ff779ed44023af0b817fdbba4077', 'request_id': 'req-2039d290-7493-463a-b4c5-78e6bb10e638'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:35.177049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a8ff779ed44023af0b817fdbba4077', 'request_id': 'req-2039d290-7493-463a-b4c5-78e6bb10e638'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:35.266380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a8ff779ed44023af0b817fdbba4077', 'request_id': 'req-2039d290-7493-463a-b4c5-78e6bb10e638'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:35.278461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] The token cache is being invalidate because project 22a8ff779ed44023af0b817fdbba4077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:35.278750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:35.279404 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2039d290-7493-463a-b4c5-78e6bb10e638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:35.281173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 992/1954] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:34 2022] DELETE /identity/v3/projects/22a8ff779ed44023af0b817fdbba4077 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:35.286545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.286855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.287129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.305662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:35.307280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:35.368644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 963/1955] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:35.377607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.377896 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.378223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.399338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:35.400574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:35.409910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 993/1956] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:35.414701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:35.426201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97886c-888d-4512-90b6-e9ee04057dab None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.431691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.432374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.432720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.432995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.434382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:35.434712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.436392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:35.450345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 964/1957] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:35.455162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:35.466312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a420a02-5ce5-4c75-906e-3cf8aa78a45f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.471263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.472268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.472547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.472882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.473612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.475721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:35.592846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 994/1958] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:35 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:35.594384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:35.607601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed8024-8320-41d4-aee7-e950ae67c354 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.666577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.667251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.667628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.668061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.668820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.670801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:35.794736 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 965/1959] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:35 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:35.801606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:35.812054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe5f98-7331-4d7d-8a46-4294c506d9f4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.823536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.824790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.825316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.825480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.826262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.827872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:35.848733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 995/1960] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:19:35.853470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:35.864544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d91f6-35f9-49c9-944f-0f0c92851bf4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.876710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6969ff-c70a-466b-b233-8c0248023a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.877557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6969ff-c70a-466b-b233-8c0248023a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.877995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6969ff-c70a-466b-b233-8c0248023a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.878342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6969ff-c70a-466b-b233-8c0248023a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.879236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6969ff-c70a-466b-b233-8c0248023a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.880921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6969ff-c70a-466b-b233-8c0248023a02 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:35.893461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 966/1961] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:35.897621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:35.908990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd042-27d9-4149-8c90-d7caa54615ea admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:35.914607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:35.915360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:35.915738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:35.916111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] PATH_INFO: `/v3/projects/b6aef6598bfb4a568bb9b3dc83875472/users/b0239f326d6142168c6c5eda3acc5354/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:35.933310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6aef6598bfb4a568bb9b3dc83875472, user_id=b0239f326d6142168c6c5eda3acc5354, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:35.936995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.037481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 996/1962] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:35 2022] PUT /identity/v3/projects/b6aef6598bfb4a568bb9b3dc83875472/users/b0239f326d6142168c6c5eda3acc5354/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:36.059744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.059744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.059744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.085962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] MFA Rules not processed for user `b0239f326d6142168c6c5eda3acc5354`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:36.087266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:36.163949 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 967/1963] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:36.169407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.234132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a8b9-ea67-47c5-9b74-a1e9e97492be admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:36.239840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:36.240516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.241441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.241666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.242684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:36.244670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.362875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 997/1964] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:36 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:36.363933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.376729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249b93-5e12-4bc9-965e-160f3b5ef9eb None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:36.444515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:36.445221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.445503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.446835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.446835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:36.448518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.536988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 968/1965] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:36 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:36.542241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.554304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98128c3-3ad3-47ce-917e-1dcbbf91b803 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:36.559607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:36.560463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.560750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.561027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.561788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:36.563603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.578585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 998/1966] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:36.582900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.593628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7bddc-4d08-475e-9e38-50c5bd9d0e0b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:36.598346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:36.599278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.599555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.599827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] PATH_INFO: `/v3/projects/f9aea2b8ddca481b8a202df01214a8d3/users/981df67452a047c186852d342970c0b2/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.619721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9aea2b8ddca481b8a202df01214a8d3, user_id=981df67452a047c186852d342970c0b2, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:36.619721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.784509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 969/1967] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:36 2022] PUT /identity/v3/projects/f9aea2b8ddca481b8a202df01214a8d3/users/981df67452a047c186852d342970c0b2/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:36.796275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.806671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8ca6-cba4-4dc4-9431-3bf12617b1d0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:36.879600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb2b7-f67c-4e56-8bd7-d0c5c8c8a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:36.880409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb2b7-f67c-4e56-8bd7-d0c5c8c8a099 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.880691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb2b7-f67c-4e56-8bd7-d0c5c8c8a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.880965 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb2b7-f67c-4e56-8bd7-d0c5c8c8a099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.881698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb2b7-f67c-4e56-8bd7-d0c5c8c8a099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:36.883618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb2b7-f67c-4e56-8bd7-d0c5c8c8a099 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.898671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 999/1968] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:36.899794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.916318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9772b-f66b-4c1b-bd79-4c70411d8ca3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:36.925316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:36.926260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.926544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.926822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] PATH_INFO: `/v3/projects/f9aea2b8ddca481b8a202df01214a8d3/users/981df67452a047c186852d342970c0b2/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.928798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9aea2b8ddca481b8a202df01214a8d3, user_id=981df67452a047c186852d342970c0b2, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:36.931525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:36.948546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 970/1969] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:36 2022] PUT /identity/v3/projects/f9aea2b8ddca481b8a202df01214a8d3/users/981df67452a047c186852d342970c0b2/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:36.958912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:36.959476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:36.959835 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:36.960130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:36.961356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:36.992942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] MFA Rules not processed for user `981df67452a047c186852d342970c0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:36.994298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:37.042784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5a46-cef7-4582-8cca-6cb91b540c48 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:37.048868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:37.049556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:37.049847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:37.050133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:37.051999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:37.083861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1000/1970] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:37.124859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:37.126183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:37.139601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 971/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:37.425296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:37.427136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:37.440847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0570cc6-929e-4618-bbe5-98e80ba4edc1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:37.444999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae6bae-79d2-4f1b-8cbf-73729a069063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:37.445705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae6bae-79d2-4f1b-8cbf-73729a069063 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:37.445965 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae6bae-79d2-4f1b-8cbf-73729a069063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:37.446299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae6bae-79d2-4f1b-8cbf-73729a069063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:37.511444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae6bae-79d2-4f1b-8cbf-73729a069063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:37.513340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae6bae-79d2-4f1b-8cbf-73729a069063 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:37.523300 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1001/1972] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:45.406599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:45.408278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:45.494007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e49a5-1e61-4844-a1a5-d090da40a9f9 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:45.502975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:45.504572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:45.505013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:45.515572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] PATH_INFO: `/v3/users/671a148c737740829e1959770dd5bd14` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:45.517317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] RBAC: Authorizing `identity:delete_user(user_id=671a148c737740829e1959770dd5bd14)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:45.519560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:45.796925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671a148c737740829e1959770dd5bd14'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:45.797583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671a148c737740829e1959770dd5bd14'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:45.804320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671a148c737740829e1959770dd5bd14'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:45.818522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671a148c737740829e1959770dd5bd14'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:45.819255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671a148c737740829e1959770dd5bd14'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:45.919604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 972/1973] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:45 2022] DELETE /identity/v3/users/671a148c737740829e1959770dd5bd14 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:45.921925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:45.922464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:45.922565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:45.953440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:45.954687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:46.026548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1002/1974] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:46.036384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:46.038193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:46.110071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117aa0-b209-4671-83ed-0ab46037631d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:46.114959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:46.114959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:46.114959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:46.115452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:46.132394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:46.132394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:46.143479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 973/1975] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:46.388626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:46.390886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:46.415441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50765-93c7-49bb-aba6-aa0df20f498c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:46.424673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:46.427152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:46.428767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:46.429170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] PATH_INFO: `/v3/users/9c79d2a209184afdaaae8756e1695e83` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:46.431914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c79d2a209184afdaaae8756e1695e83)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:46.436703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:46.670724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:46.672390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:46.689414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd1271-eb13-463b-a624-bbac53cc5936 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:46.697619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:46.699222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:46.699852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:46.700171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] PATH_INFO: `/v3/projects/8ca6068922ae4790be47d18b5dd8966f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:46.701941 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca6068922ae4790be47d18b5dd8966f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:46.703361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c79d2a209184afdaaae8756e1695e83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.704190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:46.783424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c79d2a209184afdaaae8756e1695e83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.794195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c79d2a209184afdaaae8756e1695e83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.806188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c79d2a209184afdaaae8756e1695e83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.807101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69a07c9-0932-4149-9b92-86b578a6865d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c79d2a209184afdaaae8756e1695e83'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.813397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1003/1976] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:46 2022] DELETE /identity/v3/users/9c79d2a209184afdaaae8756e1695e83 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:46.818078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:46.818639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:46.818944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:46.837043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:46.838289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:46.874488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca6068922ae4790be47d18b5dd8966f', 'request_id': 'req-80b11429-e8ec-46d4-9b69-1ad59a0000f9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.880241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca6068922ae4790be47d18b5dd8966f', 'request_id': 'req-80b11429-e8ec-46d4-9b69-1ad59a0000f9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:46.907533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1004/1977] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:46.919843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:46.921285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:46.981604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82437-3ae3-4257-81f6-97fce75e013a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:47.009492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca6068922ae4790be47d18b5dd8966f', 'request_id': 'req-80b11429-e8ec-46d4-9b69-1ad59a0000f9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.034322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] The token cache is being invalidate because project 8ca6068922ae4790be47d18b5dd8966f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:47.034647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.035317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.037524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 974/1978] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:46 2022] DELETE /identity/v3/projects/8ca6068922ae4790be47d18b5dd8966f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:47.042441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:47.044267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:47.044393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:47.044995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:47.045284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:47.045562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:47.047512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:47.118479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b11429-e8ec-46d4-9b69-1ad59a0000f9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:47.123635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:47.125097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:47.125338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:47.126269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:47.126619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:47.132282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] PATH_INFO: `/v3/users/6e667671efc448349a01ec56fbd61825` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:47.132282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e667671efc448349a01ec56fbd61825)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:47.132282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:47.137312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1005/1979] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:47.457886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:47.463010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:47.465914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e667671efc448349a01ec56fbd61825'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.466625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e667671efc448349a01ec56fbd61825'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.474262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e667671efc448349a01ec56fbd61825'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.492364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e667671efc448349a01ec56fbd61825'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.493197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e667671efc448349a01ec56fbd61825'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.547179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd9b2-f7e2-4763-ac6d-9f72416c5516 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:47.551520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:47.552168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:47.552459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:47.552741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:47.554714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:47.584771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 975/1980] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:47 2022] DELETE /identity/v3/users/6e667671efc448349a01ec56fbd61825 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:47.627097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:47.628516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:47.640503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1006/1981] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:19:47.703646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:47.705269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:47.799394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128250db-d2ac-47ce-97f0-315d5a2ac4a4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:47.804375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:47.805250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:47.805531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:47.805804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] PATH_INFO: `/v3/projects/ae23666fa9c24ed5b3e0ecdfac1f4448` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:47.807058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae23666fa9c24ed5b3e0ecdfac1f4448)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:47.809432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:47.926220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae23666fa9c24ed5b3e0ecdfac1f4448', 'request_id': 'req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:47.931888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae23666fa9c24ed5b3e0ecdfac1f4448', 'request_id': 'req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.026479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae23666fa9c24ed5b3e0ecdfac1f4448', 'request_id': 'req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.039569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] The token cache is being invalidate because project ae23666fa9c24ed5b3e0ecdfac1f4448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:48.039918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.040804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.043075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 976/1982] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:47 2022] DELETE /identity/v3/projects/ae23666fa9c24ed5b3e0ecdfac1f4448 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:48.046893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:48.057294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27499b6-9b6e-4b99-84eb-f4e34526ae1e service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:48.116544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:48.116920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:48.117816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.120004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:48.120103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.120103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] PATH_INFO: `/v3/users/683f426ed29e45988620aafd32f54a18` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.120103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=683f426ed29e45988620aafd32f54a18)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:48.123827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:48.145155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a1bc2-7f61-4421-a9f3-1b3bb7ba1f63 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:48.159412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:48.160541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.161124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.161502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] PATH_INFO: `/v3/projects/01ec78f4dda24b8ea584b7118571428f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.162943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ec78f4dda24b8ea584b7118571428f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:48.165588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:48.404327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683f426ed29e45988620aafd32f54a18'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.411450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ec78f4dda24b8ea584b7118571428f', 'request_id': 'req-d93e8f75-df0b-4e69-b23f-18dea40d1834'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.417510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ec78f4dda24b8ea584b7118571428f', 'request_id': 'req-d93e8f75-df0b-4e69-b23f-18dea40d1834'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.500082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683f426ed29e45988620aafd32f54a18'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.513757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683f426ed29e45988620aafd32f54a18'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.532657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683f426ed29e45988620aafd32f54a18'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.533553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683f426ed29e45988620aafd32f54a18'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.540331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1007/1983] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:48 2022] DELETE /identity/v3/users/683f426ed29e45988620aafd32f54a18 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:48.544760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:48.546818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:48.608978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ec78f4dda24b8ea584b7118571428f', 'request_id': 'req-d93e8f75-df0b-4e69-b23f-18dea40d1834'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.619237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659e56-3f9c-4638-b56d-3de139280e00 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:48.625812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:48.626798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.627070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.627804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] PATH_INFO: `/v3/users/a0ac76b045054e8699044297eb301cff` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.629130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ac76b045054e8699044297eb301cff)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:48.630862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] The token cache is being invalidate because project 01ec78f4dda24b8ea584b7118571428f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:48.631237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:48.631349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.635588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d93e8f75-df0b-4e69-b23f-18dea40d1834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:48.637683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 977/1984] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:48 2022] DELETE /identity/v3/projects/01ec78f4dda24b8ea584b7118571428f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:19:48.643993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73adc1-18d4-4bca-a264-f18241cc071f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.644835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73adc1-18d4-4bca-a264-f18241cc071f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.645262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73adc1-18d4-4bca-a264-f18241cc071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.672344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7f73adc1-18d4-4bca-a264-f18241cc071f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:48.673700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7f73adc1-18d4-4bca-a264-f18241cc071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:48.691444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 978/1985] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:48.699018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.699852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.700849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.730421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:48.732172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:48.746743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 979/1986] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:19:48.750303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:48.763487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743bec-61ef-4fe3-a5f2-1cc7726be800 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:48.768838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:48.769526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.769810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.770090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.770871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:48.771323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:48.772876 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:48.786807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 980/1987] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:19:48.791728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:48.809607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f7db-b37e-41c6-b22d-4ccb280e5afa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:48.817970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:48.818796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:48.819085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:48.819373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:48.820076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:48.822124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:48.917370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ac76b045054e8699044297eb301cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.009583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 981/1988] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:48 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:49.014309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.045748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ac76b045054e8699044297eb301cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.048505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ac76b045054e8699044297eb301cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.075434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ac76b045054e8699044297eb301cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.088220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8490fee1-74a6-40b7-832e-2271dc533ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ac76b045054e8699044297eb301cff'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.107582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1008/1989] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:48 2022] DELETE /identity/v3/users/a0ac76b045054e8699044297eb301cff => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:49.115088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.115434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.115889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.117083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957ea2-7832-4d75-b569-92e9f7097282 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:49.139228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:49.141845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:49.200701 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:49.201599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.206463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.206463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.206463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:49.206463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:49.229151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1009/1990] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:49.230227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.231582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:49.245701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91788d-6b63-4edf-88b5-517ea9b3ae50 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:49.251124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:49.252028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.252312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.252589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] PATH_INFO: `/v3/projects/7dc3ec5ca3a44a1fb322ddb7afed6dff` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.253872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc3ec5ca3a44a1fb322ddb7afed6dff)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:49.255817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:49.304459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 982/1991] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:49 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:19:49.309637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.309637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:49.379639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0b7c-5501-4d09-8bc6-b7684d9a3295 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:49.391223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc3ec5ca3a44a1fb322ddb7afed6dff', 'request_id': 'req-3f37a359-8aa6-4ce9-906c-580fcba03032'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.400520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc3ec5ca3a44a1fb322ddb7afed6dff', 'request_id': 'req-3f37a359-8aa6-4ce9-906c-580fcba03032'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.440478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:49.441154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.441450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.441723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.477287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc3ec5ca3a44a1fb322ddb7afed6dff', 'request_id': 'req-3f37a359-8aa6-4ce9-906c-580fcba03032'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.489954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] The token cache is being invalidate because project 7dc3ec5ca3a44a1fb322ddb7afed6dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:49.490348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.491273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.492979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1010/1992] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:49 2022] DELETE /identity/v3/projects/7dc3ec5ca3a44a1fb322ddb7afed6dff => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:49.494100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.495982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:49.527614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:49.529279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:49.542007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 983/1993] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:49.543926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.545449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:49.560624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d875a87-4104-4b94-aa93-f8dca1d2e1fc service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:49.565809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:49.566914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.567301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.568084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] PATH_INFO: `/v3/users/150ea513cbe74681b789d49d06b9b48a` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.569171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] RBAC: Authorizing `identity:delete_user(user_id=150ea513cbe74681b789d49d06b9b48a)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:49.571420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:49.579761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a359-8aa6-4ce9-906c-580fcba03032 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:49.585537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:49.586307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.586593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.586882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.587709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:49.589693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:49.604719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1011/1994] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:49.605856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.609395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:49.629192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4f961-9fbc-4039-bde5-1ec356817bc5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:49.641599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:49.641599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:49.641599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:49.641599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] PATH_INFO: `/v3/users/24ebb070b835460a940700cadd864534` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:49.641970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ebb070b835460a940700cadd864534)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:49.643588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:49.844320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150ea513cbe74681b789d49d06b9b48a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.845568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150ea513cbe74681b789d49d06b9b48a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.852485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150ea513cbe74681b789d49d06b9b48a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.869883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150ea513cbe74681b789d49d06b9b48a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.870645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150ea513cbe74681b789d49d06b9b48a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.940527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ebb070b835460a940700cadd864534'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:49.967406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 984/1995] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:49 2022] DELETE /identity/v3/users/150ea513cbe74681b789d49d06b9b48a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:49.977106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:49.978596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.050779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2901f-256e-4634-8f9a-70fed299889c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.055591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.056345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.056627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.056915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.057596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ebb070b835460a940700cadd864534'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.058064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.059931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:50.066846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ebb070b835460a940700cadd864534'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.070930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 985/1996] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:50.071792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:50.075444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.079823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ebb070b835460a940700cadd864534'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.080554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6f92afbd-4e18-49b6-b43d-5c1bb75f1549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ebb070b835460a940700cadd864534'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.087015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1012/1997] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:49 2022] DELETE /identity/v3/users/24ebb070b835460a940700cadd864534 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:50.087968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.088444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.088889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.099345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81507-c6e3-497f-97f7-ba2e16830e94 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.111961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:50.113875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.178070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.182342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.182342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.182342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] PATH_INFO: `/v3/users/8dbb7a53bcfc4cda80b8922c216b5964` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.182342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbb7a53bcfc4cda80b8922c216b5964)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.183241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:50.216475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1013/1998] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:50.221311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:50.222946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.242891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb614fe-bbb6-496e-9221-0315fa78e8d1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.249397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.250427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.250711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.250997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] PATH_INFO: `/v3/projects/05b0413809174e33a286daa2bbb08ee5/users/a0a21151107f4428b2e2f13101129bab/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.270049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b0413809174e33a286daa2bbb08ee5, user_id=a0a21151107f4428b2e2f13101129bab, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.273262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:50.401881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1014/1999] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:50 2022] PUT /identity/v3/projects/05b0413809174e33a286daa2bbb08ee5/users/a0a21151107f4428b2e2f13101129bab/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:50.403865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:50.407449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbb7a53bcfc4cda80b8922c216b5964'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.408258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbb7a53bcfc4cda80b8922c216b5964'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.412870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.416599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbb7a53bcfc4cda80b8922c216b5964'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.432967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbb7a53bcfc4cda80b8922c216b5964'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.433879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbb7a53bcfc4cda80b8922c216b5964'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.507746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e346d-5fdb-4daa-b7f4-2178c068b395 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.515545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.517118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.517559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.518000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] PATH_INFO: `/v3/projects/1161f53ddb0441fb992706e5f12903d9` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.519462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1161f53ddb0441fb992706e5f12903d9)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.521746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:50.537077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 986/2000] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:50 2022] DELETE /identity/v3/users/8dbb7a53bcfc4cda80b8922c216b5964 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:50.537077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:50.537077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.630578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716268d-8a50-439d-8fea-eb5c30ed2792 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.637749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.638901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.639207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.639520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.641831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.669766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1161f53ddb0441fb992706e5f12903d9', 'request_id': 'req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.676961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1161f53ddb0441fb992706e5f12903d9', 'request_id': 'req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.720466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.721936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff08e-582d-4cfe-b3b8-d38a676f0134 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:50.734882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 987/2001] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:50.736356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.742276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.742276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.757871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1161f53ddb0441fb992706e5f12903d9', 'request_id': 'req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.771355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] MFA Rules not processed for user `a0a21151107f4428b2e2f13101129bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:50.774301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] The token cache is being invalidate because project 1161f53ddb0441fb992706e5f12903d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:50.774663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.774863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.775334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:50.780771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1015/2002] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:50 2022] DELETE /identity/v3/projects/1161f53ddb0441fb992706e5f12903d9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:50.781722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:50.783739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.864322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 988/2003] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:50.866742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:50.868543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:50.872238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb45943-5bd4-42e0-ba9f-d8fe0fffd78e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.878464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.879729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.880159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.880680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] PATH_INFO: `/v3/projects/7cea1b168aad4a06ba451aefc1629ab7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.882644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cea1b168aad4a06ba451aefc1629ab7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.884628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:50.887289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653bb3-7d20-4a1b-9966-0e56cedd8f63 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:50.894261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:50.894609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:50.894879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:50.895237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] PATH_INFO: `/v3/users/fc376ffe0bde4070998fd0ff642ca92f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:50.896775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc376ffe0bde4070998fd0ff642ca92f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:50.899072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:51.114909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cea1b168aad4a06ba451aefc1629ab7', 'request_id': 'req-5cc8b24d-264b-46ce-8f29-2127305f593f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.115484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc376ffe0bde4070998fd0ff642ca92f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.116025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc376ffe0bde4070998fd0ff642ca92f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.124681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc376ffe0bde4070998fd0ff642ca92f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.127692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cea1b168aad4a06ba451aefc1629ab7', 'request_id': 'req-5cc8b24d-264b-46ce-8f29-2127305f593f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.140620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc376ffe0bde4070998fd0ff642ca92f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.141374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc376ffe0bde4070998fd0ff642ca92f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.196572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cea1b168aad4a06ba451aefc1629ab7', 'request_id': 'req-5cc8b24d-264b-46ce-8f29-2127305f593f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.211368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] The token cache is being invalidate because project 7cea1b168aad4a06ba451aefc1629ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:51.212086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.212856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.215026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1016/2004] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:50 2022] DELETE /identity/v3/projects/7cea1b168aad4a06ba451aefc1629ab7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:51.216581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:51.218740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.254242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 989/2005] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:50 2022] DELETE /identity/v3/users/fc376ffe0bde4070998fd0ff642ca92f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:51.256179 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:51.258804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.297996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b24d-264b-46ce-8f29-2127305f593f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:51.353862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08d27-c09a-43da-af49-ccf7bc59eec7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:51.360938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:51.361945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.362275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.362841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.363315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:51.365535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:51.380553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:51.382001 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.382325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.382609 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] PATH_INFO: `/v3/projects/cc58e300bfaa41acabc1a63ae6861fe9` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.386999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc58e300bfaa41acabc1a63ae6861fe9)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:51.389182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:51.507713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 990/2006] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:51 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:51.508699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:51.510621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.522224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc58e300bfaa41acabc1a63ae6861fe9', 'request_id': 'req-cb80cb75-6a4d-4914-a4d4-a4c002c83125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.530311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc58e300bfaa41acabc1a63ae6861fe9', 'request_id': 'req-cb80cb75-6a4d-4914-a4d4-a4c002c83125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.609916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5db9-d043-4e4e-a283-5521d39cf81e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:51.620778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc58e300bfaa41acabc1a63ae6861fe9', 'request_id': 'req-cb80cb75-6a4d-4914-a4d4-a4c002c83125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.623462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:51.624710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.625142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.625565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] PATH_INFO: `/v3/projects/c3e6750929a045588d64b61b0f7cf18f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.630631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e6750929a045588d64b61b0f7cf18f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:51.632663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:51.634935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] The token cache is being invalidate because project cc58e300bfaa41acabc1a63ae6861fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:51.635341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.636165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-cb80cb75-6a4d-4914-a4d4-a4c002c83125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.641349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1017/2007] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:51 2022] DELETE /identity/v3/projects/cc58e300bfaa41acabc1a63ae6861fe9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:51.641349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.641349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.641349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.663252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:51.664543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.679550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1018/2008] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:51.680885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:51.685296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.697342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09871a-29bc-4e99-a5e3-da0295254d63 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:51.702308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ba70-5399-4924-9ed4-5c4e7112c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:51.713958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ba70-5399-4924-9ed4-5c4e7112c06a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.713958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ba70-5399-4924-9ed4-5c4e7112c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.713958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ba70-5399-4924-9ed4-5c4e7112c06a admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.713958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871ba70-5399-4924-9ed4-5c4e7112c06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:51.713958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871ba70-5399-4924-9ed4-5c4e7112c06a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:51.832835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e6750929a045588d64b61b0f7cf18f', 'request_id': 'req-be6bfca0-521a-4b4f-b882-db0039d9ccb6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.837932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e6750929a045588d64b61b0f7cf18f', 'request_id': 'req-be6bfca0-521a-4b4f-b882-db0039d9ccb6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.869059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1019/2009] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:51 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:51.869059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac345e7-56fe-4d10-86db-a6b84630d283 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.869059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac345e7-56fe-4d10-86db-a6b84630d283 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.869059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac345e7-56fe-4d10-86db-a6b84630d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.886900 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1ac345e7-56fe-4d10-86db-a6b84630d283 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:51.888489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1ac345e7-56fe-4d10-86db-a6b84630d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.950964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1020/2010] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:51.952309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:51.952632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:51.952981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:51.978515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:51.979740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.983039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e6750929a045588d64b61b0f7cf18f', 'request_id': 'req-be6bfca0-521a-4b4f-b882-db0039d9ccb6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.989595 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1021/2011] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:51.990539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:51.991827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:51.998571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] The token cache is being invalidate because project c3e6750929a045588d64b61b0f7cf18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:51.998946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:51.999681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.002253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 991/2012] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:51 2022] DELETE /identity/v3/projects/c3e6750929a045588d64b61b0f7cf18f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:52.003269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.004550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a84b-5dab-4029-a575-46789c730de7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.004664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.009584 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.010629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.010948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.011224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] PATH_INFO: `/v3/projects/53ffddf95c074c80b2a70e43cc6dd540` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.012566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ffddf95c074c80b2a70e43cc6dd540)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.014594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.018264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bfca0-521a-4b4f-b882-db0039d9ccb6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.026009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b829c-9d04-4a85-8a56-c690e07b8882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.026779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b829c-9d04-4a85-8a56-c690e07b8882 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.027049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b829c-9d04-4a85-8a56-c690e07b8882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.027817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b829c-9d04-4a85-8a56-c690e07b8882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.028856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b829c-9d04-4a85-8a56-c690e07b8882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.030532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b829c-9d04-4a85-8a56-c690e07b8882 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.042905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 992/2013] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:52.045749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.045749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.050507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.066320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:52.067536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.076294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 993/2014] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:52.077263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.079193 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.093151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468bae8-96cd-44b4-b2cc-ad446d81b9b2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.098981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.099830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.100118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.100397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.101140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:52.101446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.103098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.115810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 994/2015] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:52.116805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.118594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.133067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e23a-724d-4d35-8b6a-43a02f305993 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.138635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.139513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.139790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.140061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] PATH_INFO: `/v3/users/2de90534cb664128b13cc91138024ddf` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.141796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de90534cb664128b13cc91138024ddf)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.144877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.154041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ffddf95c074c80b2a70e43cc6dd540', 'request_id': 'req-fde95056-fc69-4043-a1f8-3511023f9671'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.168594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ffddf95c074c80b2a70e43cc6dd540', 'request_id': 'req-fde95056-fc69-4043-a1f8-3511023f9671'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.283087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ffddf95c074c80b2a70e43cc6dd540', 'request_id': 'req-fde95056-fc69-4043-a1f8-3511023f9671'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.295280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] The token cache is being invalidate because project 53ffddf95c074c80b2a70e43cc6dd540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:52.295580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.296278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.297884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1022/2016] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:51 2022] DELETE /identity/v3/projects/53ffddf95c074c80b2a70e43cc6dd540 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:52.298661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.299969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.370067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde95056-fc69-4043-a1f8-3511023f9671 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.375292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.376381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.376658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.380506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] PATH_INFO: `/v3/projects/162599a252ad4d7bb2b81fab9a9c4cc4/users/94eeb6ca6650460eadf12f873ddd1635/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.385271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de90534cb664128b13cc91138024ddf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.385987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de90534cb664128b13cc91138024ddf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.395051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de90534cb664128b13cc91138024ddf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.395256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162599a252ad4d7bb2b81fab9a9c4cc4, user_id=94eeb6ca6650460eadf12f873ddd1635, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.397789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.408722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de90534cb664128b13cc91138024ddf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.409450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de90534cb664128b13cc91138024ddf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:52.501678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1023/2017] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:52 2022] PUT /identity/v3/projects/162599a252ad4d7bb2b81fab9a9c4cc4/users/94eeb6ca6650460eadf12f873ddd1635/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:52.502801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.504593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.511533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 995/2018] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:52 2022] DELETE /identity/v3/users/2de90534cb664128b13cc91138024ddf => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:52.512555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.513964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.581607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421fc7-9bca-4425-b812-d744df763ce1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.587511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.588239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.588533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.588791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.589598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:52.590551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.592406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1fff-e923-4c77-a896-c4b03c08610b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.594672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b726-c7ca-4cb0-a0fe-ec254c34d651 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.600066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55db8-1ef5-4e8f-a826-c2c65a4b1667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.600636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55db8-1ef5-4e8f-a826-c2c65a4b1667 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.601017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55db8-1ef5-4e8f-a826-c2c65a4b1667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.601317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55db8-1ef5-4e8f-a826-c2c65a4b1667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.602344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55db8-1ef5-4e8f-a826-c2c65a4b1667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.604050 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55db8-1ef5-4e8f-a826-c2c65a4b1667 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.606177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1024/2019] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:52.607863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.611548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.611548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.628519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:52.629706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.637808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1025/2020] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:52.638834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.650297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.652199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2528bc-5486-4d15-acbd-6fc7089206e3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.659332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.659901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.660165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.660440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.661171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.662832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.674076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1026/2021] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:52.674974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.685686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911a68f-751d-4650-ad14-191f8796098b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.690723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.691418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.691700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.691998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.692692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.694855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.707799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 996/2022] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:52.709161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.709514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.709843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.728546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:52.729734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:52.797802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 997/2023] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:52.799235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.811116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f747129-33bf-455c-8ba3-90efe47306a2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.817238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.818378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.818750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.823026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] PATH_INFO: `/v3/projects/162599a252ad4d7bb2b81fab9a9c4cc4/users/94eeb6ca6650460eadf12f873ddd1635/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.823026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=162599a252ad4d7bb2b81fab9a9c4cc4, user_id=94eeb6ca6650460eadf12f873ddd1635, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.825668 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.857788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 998/2024] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:52 2022] PUT /identity/v3/projects/162599a252ad4d7bb2b81fab9a9c4cc4/users/94eeb6ca6650460eadf12f873ddd1635/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:52.858371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.894337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1027/2025] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/projects => generated 393 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:52.894337 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:52.939648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0dfa-6ab9-404d-b6a4-914d08fec65e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.966042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61832d-323f-448a-8d2d-2553a819bb5e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:52.971271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:52.971984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.972421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.972703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:52.973450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:52.973763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:52.975504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f63e9f-d78e-46fa-9153-272c597948e8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:52.991714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1028/2026] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:52.993245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:52.993545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:52.993824 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.007747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.008468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.008750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.009021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.009715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.011676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.031076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] MFA Rules not processed for user `94eeb6ca6650460eadf12f873ddd1635`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:53.032732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.109302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1029/2027] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:53.110522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.119390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 999/2028] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:52 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:53.119390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.129645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539ecb-be77-4baa-8faf-f79d98d13e69 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.131308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ac732-1a1e-4d36-b874-4f11424c9f80 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.135389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.137708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.143082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.143251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.143379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.143462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.143535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.143635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.143742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.143870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.143976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.144054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.262225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1030/2029] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:53 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:53.262225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.262960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1000/2030] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:53 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:53.262960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.263158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.270854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e399-c347-4aac-9516-e951aa9bf3b6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.326350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf7e65-7a4f-4548-ad5e-f2f826cbfa0c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.332709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.333398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.333684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.333961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.334807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.334935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.335834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.336177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.336511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] PATH_INFO: `/v3/projects/c56cfac62eb24e6ca4650edb081e26ef` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.336664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.337776 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56cfac62eb24e6ca4650edb081e26ef)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.340364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.348548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1001/2031] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:53.349635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.351455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.418707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7437cc9-59c7-45cf-9352-a8055645d468 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.422609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.423266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.423550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.423823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.483210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56cfac62eb24e6ca4650edb081e26ef', 'request_id': 'req-811234fc-d76a-4f5f-abf4-82111217b8e2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.487944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.489444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.489564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56cfac62eb24e6ca4650edb081e26ef', 'request_id': 'req-811234fc-d76a-4f5f-abf4-82111217b8e2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.499815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1002/2032] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:53.500631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.511048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfa492-9198-4c93-89a9-48f578710f63 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.573242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.573923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.574335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.574780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.575601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.577260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.587745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1003/2033] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:53.588576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.589280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56cfac62eb24e6ca4650edb081e26ef', 'request_id': 'req-811234fc-d76a-4f5f-abf4-82111217b8e2'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.602637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0914b0b-f887-4bce-a11f-c3065d358f6d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.604038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] The token cache is being invalidate because project c56cfac62eb24e6ca4650edb081e26ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:53.604329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.604997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.607304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1031/2034] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:53 2022] DELETE /identity/v3/projects/c56cfac62eb24e6ca4650edb081e26ef => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:53.609494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.610235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.610712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.611020 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.611489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.611735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.613760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.614858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.628815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811234fc-d76a-4f5f-abf4-82111217b8e2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.634624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.635188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.635528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.635836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.636649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.639016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.649327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1032/2035] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:53.650203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.653271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.666353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1f10b-6992-474a-bccc-a3372e01b98b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.671255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.672166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.672443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.672717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] PATH_INFO: `/v3/users/a0a21151107f4428b2e2f13101129bab` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.673924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a21151107f4428b2e2f13101129bab)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.675859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.716124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1004/2036] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:53 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:53.719932 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.721658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.733766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c5f9-4de3-41ad-a061-9e125ad529c6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.738683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49e6cb-5981-4c92-915c-06adb12bc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.739339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e6cb-5981-4c92-915c-06adb12bc9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.739605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e6cb-5981-4c92-915c-06adb12bc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.739888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49e6cb-5981-4c92-915c-06adb12bc9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.740618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e6cb-5981-4c92-915c-06adb12bc9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.742260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49e6cb-5981-4c92-915c-06adb12bc9d3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.754067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1005/2037] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:53.755493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.755783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.756060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.775303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:53.776606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.785544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1006/2038] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:53.786512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.796921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597f564-884e-48d4-9ede-f522bc53b5ea None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.802170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.803083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.803363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.803638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] PATH_INFO: `/v3/projects/8503db4bd6cb40e6a2fbaf2b08b00a25/users/2902257aadae42159632227998e645d3/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.820737 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8503db4bd6cb40e6a2fbaf2b08b00a25, user_id=2902257aadae42159632227998e645d3, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.824832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.857555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a21151107f4428b2e2f13101129bab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.900709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1007/2039] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:53 2022] PUT /identity/v3/projects/8503db4bd6cb40e6a2fbaf2b08b00a25/users/2902257aadae42159632227998e645d3/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:53.901526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.903474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.951649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a21151107f4428b2e2f13101129bab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.959615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a21151107f4428b2e2f13101129bab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.972852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a21151107f4428b2e2f13101129bab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.973605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a21151107f4428b2e2f13101129bab'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:53.974920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652017-bf0b-47f3-acef-426ba8a6cd02 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:53.979556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8959-904c-4a94-97ca-03fd9891259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:53.979728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1033/2040] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:53 2022] DELETE /identity/v3/users/a0a21151107f4428b2e2f13101129bab => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:53.980226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8959-904c-4a94-97ca-03fd9891259b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.980330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:53.981183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8959-904c-4a94-97ca-03fd9891259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:53.981513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8959-904c-4a94-97ca-03fd9891259b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:53.982325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8959-904c-4a94-97ca-03fd9891259b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:53.982502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:53.984083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8959-904c-4a94-97ca-03fd9891259b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:53.997611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1008/2041] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:53.999225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3303-9e6f-4c8e-af06-0d39546e0780 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:53.999700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3303-9e6f-4c8e-af06-0d39546e0780 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.000132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3303-9e6f-4c8e-af06-0d39546e0780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.020312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-486a3303-9e6f-4c8e-af06-0d39546e0780 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:54.021506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-486a3303-9e6f-4c8e-af06-0d39546e0780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.053548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8070-3efd-43e4-bf60-58a79ddcee5e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.058330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023328fb-707d-4df9-9256-553b17f1f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.060047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023328fb-707d-4df9-9256-553b17f1f703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.060331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023328fb-707d-4df9-9256-553b17f1f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.060603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023328fb-707d-4df9-9256-553b17f1f703 admin admin] PATH_INFO: `/v3/projects/3c7a1b34470341c88e3b1f1eefd94c52/users/e192d9ed33cc4852b691f9278242fdaa/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.076356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023328fb-707d-4df9-9256-553b17f1f703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7a1b34470341c88e3b1f1eefd94c52, user_id=e192d9ed33cc4852b691f9278242fdaa, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.079087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023328fb-707d-4df9-9256-553b17f1f703 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.087051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1009/2042] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:54.088543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.088838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.089116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.115183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] MFA Rules not processed for user `2902257aadae42159632227998e645d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:54.116366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.145892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1034/2043] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:53 2022] PUT /identity/v3/projects/3c7a1b34470341c88e3b1f1eefd94c52/users/e192d9ed33cc4852b691f9278242fdaa/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:54.147194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.147484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.147762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.165338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:54.166486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.188760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1010/2044] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:54.189710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.191328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.207975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfa789-6e32-49a4-a447-ffc482a7ad75 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.236448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1035/2045] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:54.237463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.238983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.251656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3820965-04ae-428a-9da8-9d0656ea6490 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.256417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.257296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.257579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.257856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] PATH_INFO: `/v3/users/b0239f326d6142168c6c5eda3acc5354` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.259201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0239f326d6142168c6c5eda3acc5354)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.261167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.270464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.271150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.271423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.271691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.272431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.274271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.284578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1011/2046] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:54.285416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.295185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38862-3ec9-49fd-a2f2-25f639aa004c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.300402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.301065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.301431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.301706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.302477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:54.306053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.306053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba83e5d-c222-48b2-8807-31a3b8430349 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.317244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1012/2047] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:54.318655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.318942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.319245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.336928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:54.338149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.346529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1013/2048] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:54.347347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.351919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.407908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57bb7-74ae-40a6-9b93-e95491b278b1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.411751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.412396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.412682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.412956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.472048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.473405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.483686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0239f326d6142168c6c5eda3acc5354'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:54.484409 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1014/2049] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:54.484986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.486337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.546368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fb04-c37b-42f9-8174-ee38c350e0c5 service glance] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.552158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.552891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.553210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.553515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.564332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.565802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.565919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0239f326d6142168c6c5eda3acc5354'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:54.574199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0239f326d6142168c6c5eda3acc5354'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:54.579072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1015/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:54.581234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.591594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba9f5-7b48-46da-ae30-9ba2f47ec952 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.597625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0239f326d6142168c6c5eda3acc5354'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:54.597931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.598970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.604732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.604732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] PATH_INFO: `/v3/projects/058fc45260564648a1cdcfa4c839d1ec/users/69cdd1f6055e4b018bc5aff013998ba6/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.606774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0239f326d6142168c6c5eda3acc5354'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:54.618460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=058fc45260564648a1cdcfa4c839d1ec, user_id=69cdd1f6055e4b018bc5aff013998ba6, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.620537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1036/2051] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:54 2022] DELETE /identity/v3/users/b0239f326d6142168c6c5eda3acc5354 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:54.622266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.625204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.631657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.706730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964a3de-109d-4ebb-84c2-39f74a36e80a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.711433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e953b-0f8f-4992-82c1-1d46301049eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.712104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e953b-0f8f-4992-82c1-1d46301049eb admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.712383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e953b-0f8f-4992-82c1-1d46301049eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.712660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e953b-0f8f-4992-82c1-1d46301049eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.713357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e953b-0f8f-4992-82c1-1d46301049eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.716389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e953b-0f8f-4992-82c1-1d46301049eb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.815801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1016/2052] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:54 2022] PUT /identity/v3/projects/058fc45260564648a1cdcfa4c839d1ec/users/69cdd1f6055e4b018bc5aff013998ba6/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:54.817104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:54.818967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.846853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1037/2053] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:54 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:54.848569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ff17-2ac7-4694-8760-43c8fa993836 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.849012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ff17-2ac7-4694-8760-43c8fa993836 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.849612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ff17-2ac7-4694-8760-43c8fa993836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.872693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c2f5ff17-2ac7-4694-8760-43c8fa993836 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:54.874163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c2f5ff17-2ac7-4694-8760-43c8fa993836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.896134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb84fb-cdac-4c86-a058-0bdb75491c63 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:54.961120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:54.961725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1038/2054] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:54.962117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.962414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.962753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.963228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:54.963636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:54.963962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:54.964720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:54.979123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:54.980616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:54.997909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] MFA Rules not processed for user `69cdd1f6055e4b018bc5aff013998ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:54.999228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:55.002337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1017/2055] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:55.004294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.023580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad476a9c-196e-4f0e-955e-d6dd52026b30 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.030626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.031248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.031527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.031803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.032501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.034621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.077293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1039/2056] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:55.078024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.088235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142e8e-d01a-4e91-aa4e-1d23b63013f2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.092828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.093520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.093800 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.094096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.104766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.106901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.122863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1040/2057] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:55.123562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.125883 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:55.140439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3830e4-e88f-4909-9769-f52935cec56c service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.147169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.147788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.148090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.148339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.149047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.154750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.190482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1018/2058] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:55 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:55.191446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.193153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:55.206097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03401f8c-ade4-49b6-b20b-d34da0c83794 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.211343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.212279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.212565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.212846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] PATH_INFO: `/v3/projects/05b0413809174e33a286daa2bbb08ee5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.214056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b0413809174e33a286daa2bbb08ee5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.216138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.311151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1041/2059] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:55 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:55.311151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.371874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252f6f8-c7b2-473d-a70d-d4a1090034af admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.377010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.377677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.377966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.378340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.379360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.380980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.401446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1042/2060] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:55.402353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.421216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b0413809174e33a286daa2bbb08ee5', 'request_id': 'req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:55.425469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7901b0-63ed-4bcd-877f-7f62a27885a9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.428099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b0413809174e33a286daa2bbb08ee5', 'request_id': 'req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:55.504765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.507736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.507736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.507736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.507736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.509365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.526331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b0413809174e33a286daa2bbb08ee5', 'request_id': 'req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:55.552199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] The token cache is being invalidate because project 05b0413809174e33a286daa2bbb08ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:55.553310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:55.554889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:55.560593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1019/2061] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:55 2022] DELETE /identity/v3/projects/05b0413809174e33a286daa2bbb08ee5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:55.561560 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.563066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:55.579979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd00b00-bb43-422b-bbb6-2d8d49e4b192 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.588989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.590382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.590778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.591256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.592082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.593923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.621923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1020/2062] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:55.621923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.624943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:55.639974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1b63-8ace-4998-9608-07d9dc922d2a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.646927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.647914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.648276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.648615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] PATH_INFO: `/v3/users/94eeb6ca6650460eadf12f873ddd1635` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.649918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94eeb6ca6650460eadf12f873ddd1635)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.655459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.683893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1043/2063] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:55 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:55.705479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.705479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faafa1-9d13-4b74-8c5a-0f512f7bc7e6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:55.705479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:55.705479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:55.705883 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:55.705883 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] PATH_INFO: `/v3/projects/6dc8dcb544504ac8a63066732232d6df/users/982b9871afeb487bbadadf0ca526a3a8/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:55.716835 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc8dcb544504ac8a63066732232d6df, user_id=982b9871afeb487bbadadf0ca526a3a8, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:55.719504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:55.982297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1044/2064] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:55 2022] PUT /identity/v3/projects/6dc8dcb544504ac8a63066732232d6df/users/982b9871afeb487bbadadf0ca526a3a8/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:55.982297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:55.993730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:56.092358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b1a3-0927-43f5-9dc3-452e91a298bf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:56.100279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:56.101420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:56.101999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:56.102656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:56.104774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:56.108590 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:56.125731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1045/2065] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:56.131985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:56.131985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:56.143830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5a13-4ddc-4765-86c0-96a7e23af724 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:56.148509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:56.149400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:56.149686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:56.149997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] PATH_INFO: `/v3/projects/b6aef6598bfb4a568bb9b3dc83875472` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:56.153249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6aef6598bfb4a568bb9b3dc83875472)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:56.161131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:56.222567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94eeb6ca6650460eadf12f873ddd1635'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.223267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94eeb6ca6650460eadf12f873ddd1635'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.233735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94eeb6ca6650460eadf12f873ddd1635'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.254935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94eeb6ca6650460eadf12f873ddd1635'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.256085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-375e7957-a32f-4223-b548-293866179a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94eeb6ca6650460eadf12f873ddd1635'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.312089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6aef6598bfb4a568bb9b3dc83875472', 'request_id': 'req-16d84df2-1cd0-484e-85db-1fb496bb5335'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.318183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6aef6598bfb4a568bb9b3dc83875472', 'request_id': 'req-16d84df2-1cd0-484e-85db-1fb496bb5335'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.394661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1021/2066] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:55 2022] DELETE /identity/v3/users/94eeb6ca6650460eadf12f873ddd1635 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:56.399365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:56.399652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:56.400552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:56.433019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] MFA Rules not processed for user `982b9871afeb487bbadadf0ca526a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:56.434375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:56.488669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6aef6598bfb4a568bb9b3dc83875472', 'request_id': 'req-16d84df2-1cd0-484e-85db-1fb496bb5335'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.509366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] The token cache is being invalidate because project b6aef6598bfb4a568bb9b3dc83875472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:56.510096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.510602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.513058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1046/2067] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:56 2022] DELETE /identity/v3/projects/b6aef6598bfb4a568bb9b3dc83875472 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:56.514267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:56.520644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:56.529158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1022/2068] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:56.529158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:56.531697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:56.617717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d84df2-1cd0-484e-85db-1fb496bb5335 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:56.641217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5681-5550-45d4-ac15-a27fe1492629 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:56.657267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:56.658771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:56.658771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:56.659356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] PATH_INFO: `/v3/users/981df67452a047c186852d342970c0b2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:56.660785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=981df67452a047c186852d342970c0b2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:56.663124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:56.704270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:56.704988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:56.705280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:56.705559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:56.706343 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:56.708153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:56.723405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1047/2069] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:56.724485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:56.728680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:56.774482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bb6ea-7824-4ce8-9d9a-61a76e4c5564 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:56.780912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:56.781602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:56.781959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:56.782265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:56.783716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:56.787041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:56.893302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1048/2070] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:56 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:56.894259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:56.898002 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981df67452a047c186852d342970c0b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.898824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981df67452a047c186852d342970c0b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.907303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981df67452a047c186852d342970c0b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.934553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981df67452a047c186852d342970c0b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:56.935413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981df67452a047c186852d342970c0b2'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:57.015487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fdda5-3420-4556-bd60-bbf841130012 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:57.023772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:57.024703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.024980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.025253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] PATH_INFO: `/v3/projects/11846796cdde4e4f8834eac2f49394f7/users/87164afb5923487c91fe2c3621f75bd4/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.044009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11846796cdde4e4f8834eac2f49394f7, user_id=87164afb5923487c91fe2c3621f75bd4, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:57.047446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:57.084210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1023/2071] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:56 2022] DELETE /identity/v3/users/981df67452a047c186852d342970c0b2 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:57.091211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:57.091211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.209959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1049/2072] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:56 2022] PUT /identity/v3/projects/11846796cdde4e4f8834eac2f49394f7/users/87164afb5923487c91fe2c3621f75bd4/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:57.209959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:57.209959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.243739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e5251-d3c6-47a8-894c-97683995d3cb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:57.322485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6153c-b1ee-4d49-88c1-9a7e4c024fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:57.323513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6153c-b1ee-4d49-88c1-9a7e4c024fad admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.324113 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6153c-b1ee-4d49-88c1-9a7e4c024fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.325446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6153c-b1ee-4d49-88c1-9a7e4c024fad admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.326764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6153c-b1ee-4d49-88c1-9a7e4c024fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:57.328798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6153c-b1ee-4d49-88c1-9a7e4c024fad admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:57.343390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88190e-d9a3-428e-9b83-e27e1267c47f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:57.357743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:57.357743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.357743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.357743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] PATH_INFO: `/v3/projects/162599a252ad4d7bb2b81fab9a9c4cc4` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.358531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] RBAC: Authorizing `identity:delete_project(project_id=162599a252ad4d7bb2b81fab9a9c4cc4)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:57.358531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:57.465242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1024/2073] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:57 2022] POST /identity/v3/users => generated 299 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:57.469164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f32a-d2b9-4164-9d0b-b532490e3c10 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.469843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f32a-d2b9-4164-9d0b-b532490e3c10 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.470440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f32a-d2b9-4164-9d0b-b532490e3c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.518291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162599a252ad4d7bb2b81fab9a9c4cc4', 'request_id': 'req-6dd19e74-1964-44c0-aba7-81c68d52797b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:57.528515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162599a252ad4d7bb2b81fab9a9c4cc4', 'request_id': 'req-6dd19e74-1964-44c0-aba7-81c68d52797b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:57.534284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c7e6f32a-d2b9-4164-9d0b-b532490e3c10 None None] MFA Rules not processed for user `87164afb5923487c91fe2c3621f75bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:57.536614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7e6f32a-d2b9-4164-9d0b-b532490e3c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.608934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162599a252ad4d7bb2b81fab9a9c4cc4', 'request_id': 'req-6dd19e74-1964-44c0-aba7-81c68d52797b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:57.631439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] The token cache is being invalidate because project 162599a252ad4d7bb2b81fab9a9c4cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:57.631995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:57.632726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:57.634484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1050/2074] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:57 2022] DELETE /identity/v3/projects/162599a252ad4d7bb2b81fab9a9c4cc4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:57.635669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:57.637817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.648226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1025/2075] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:57.651056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.655346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.655346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.680795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:57.689240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.750946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd19e74-1964-44c0-aba7-81c68d52797b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:57.760310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:57.761187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.761530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.762430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.763289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:57.765402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:57.779444 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1051/2076] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:57.780383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:57.782359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.799903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a01cc-7eb1-4853-8ad6-d8797e87e9fa admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:57.819302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1026/2077] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:57.819302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:57.819490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546baa0-5872-4007-9757-2a428542e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:57.819490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546baa0-5872-4007-9757-2a428542e389 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.824240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546baa0-5872-4007-9757-2a428542e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.824240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546baa0-5872-4007-9757-2a428542e389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.824240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546baa0-5872-4007-9757-2a428542e389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:57.824240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546baa0-5872-4007-9757-2a428542e389 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:57.837396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701ee34-34f6-4ef6-8cda-c2c3f52df489 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:57.850776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:57.851730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.851966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.852215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] PATH_INFO: `/v3/projects/44f7b4d7b240485aad43e73add2184bd/users/f91f7af8d228483db19f10119855129b/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.878166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f7b4d7b240485aad43e73add2184bd, user_id=f91f7af8d228483db19f10119855129b, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:57.881154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:57.916890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1052/2078] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:57 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:57.924433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:57.924433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:57.924433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:57.940944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:57.942475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:57.978656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1027/2079] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:57 2022] PUT /identity/v3/projects/44f7b4d7b240485aad43e73add2184bd/users/f91f7af8d228483db19f10119855129b/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:57.981650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.021299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1053/2080] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:58.024551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.034886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0751c33-2490-4de9-aefe-1c995129b8e0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.056357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc0ed-da82-4af0-9c86-19d6fc398c46 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.062959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.064472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.065136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.065767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.067072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.069454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.121973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.123474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.123763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.124044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.124969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.128086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.141735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1054/2081] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:58.141735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.157394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2a28-80b8-4224-9b1f-c0b7e3876efa admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.166517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1028/2082] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:57 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:58.171253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.171514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.171514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.171514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.171514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.171839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:58.172284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.174022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.175954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.190797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1055/2083] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:58.191973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.210324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645d7f2-f073-4e85-86ac-60c43616ae73 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.211933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700008-45b0-4cbc-8823-1c8b3ea42028 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.216779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.217489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.217776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.218047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] PATH_INFO: `/v3/projects/f9aea2b8ddca481b8a202df01214a8d3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.219348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9aea2b8ddca481b8a202df01214a8d3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.219816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.220730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.221141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.221449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] PATH_INFO: `/v3/projects/44f7b4d7b240485aad43e73add2184bd/users/f91f7af8d228483db19f10119855129b/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.222690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.224382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f7b4d7b240485aad43e73add2184bd, user_id=f91f7af8d228483db19f10119855129b, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.227255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.257157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1056/2084] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:58 2022] PUT /identity/v3/projects/44f7b4d7b240485aad43e73add2184bd/users/f91f7af8d228483db19f10119855129b/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:58.257157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.335052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1f583-06a2-47d1-aaf0-d6a19f964d8b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.341857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.342697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.343371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.343371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.344504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.346187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.359355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1057/2085] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:58.360520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.375925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a173bd-ced0-45c0-a22e-69d929526ab9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.378007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9aea2b8ddca481b8a202df01214a8d3', 'request_id': 'req-5ef9a792-96dc-41b0-b3a9-a98df370e66a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:58.400351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9aea2b8ddca481b8a202df01214a8d3', 'request_id': 'req-5ef9a792-96dc-41b0-b3a9-a98df370e66a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:58.479589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.479942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.480228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.480723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.481311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.483207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.486887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9aea2b8ddca481b8a202df01214a8d3', 'request_id': 'req-5ef9a792-96dc-41b0-b3a9-a98df370e66a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:58.509648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] The token cache is being invalidate because project f9aea2b8ddca481b8a202df01214a8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:19:58.509937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:58.510687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5ef9a792-96dc-41b0-b3a9-a98df370e66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:58.518764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1029/2086] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:19:58 2022] DELETE /identity/v3/projects/f9aea2b8ddca481b8a202df01214a8d3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:58.518764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1643f9-8577-41bc-9bda-16cda24206b8 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.518764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1643f9-8577-41bc-9bda-16cda24206b8 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.518764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1643f9-8577-41bc-9bda-16cda24206b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.555538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9c1643f9-8577-41bc-9bda-16cda24206b8 None None] MFA Rules not processed for user `f91f7af8d228483db19f10119855129b`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:58.556904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9c1643f9-8577-41bc-9bda-16cda24206b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.588581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1058/2087] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:58 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:58.589137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.593593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.660943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1030/2088] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:58.665877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.665877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.666072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.688281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:58.689502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.701161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5516e-145b-4cdf-bc77-af2288d3169b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.701943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1031/2089] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:58.702805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.704079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.712154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.715112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.715112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.715112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] PATH_INFO: `/v3/projects/12ec3acac95b438dafc350d45909b8ec/users/0f3e4bd2a5af4cb8a2c29e008f1ea3e0/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.716430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615e6ee-727d-489c-b87c-39e08ac3861e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.722058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7a75-eafb-4d7c-aaf4-3e62df282f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.722339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7a75-eafb-4d7c-aaf4-3e62df282f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.722582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7a75-eafb-4d7c-aaf4-3e62df282f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.722961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7a75-eafb-4d7c-aaf4-3e62df282f1e admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.723739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d7a75-eafb-4d7c-aaf4-3e62df282f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.725670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d7a75-eafb-4d7c-aaf4-3e62df282f1e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.729668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ec3acac95b438dafc350d45909b8ec, user_id=0f3e4bd2a5af4cb8a2c29e008f1ea3e0, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:58.733099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:58.837420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1059/2090] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:58 2022] PUT /identity/v3/projects/12ec3acac95b438dafc350d45909b8ec/users/0f3e4bd2a5af4cb8a2c29e008f1ea3e0/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:58.838625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:58.841943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.897731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1032/2091] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:58 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:58.899397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.901427 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.901827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:58.942277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:58.945687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:58.957054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd60b7-2149-473b-af61-fe891fdab654 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:58.970046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:58.971361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:58.971548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:58.972266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.046386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1033/2092] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:59.051244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.066808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009093-e66a-4707-a0a6-0f899ee57666 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.083094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.086812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.086812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.086812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.086812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.087515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.097887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.100298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.100457 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1034/2093] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:59.104589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.118391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1060/2094] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:19:59.118553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ff31-c0c3-47b1-a403-a46077a875be admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.118641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.122262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.123207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.123487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.123920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.124710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.126379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.135301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184eb6d-a7ef-4b5e-893f-1ee538e183f3 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.143364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.144134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1035/2095] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:59.156797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.156797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.156797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.156797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:19:59.156797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.156797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.158963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.159844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3d97-9333-4411-829d-2ce3a19c94df admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.163843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1061/2096] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:19:59.164883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.165346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.165810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.166086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.166395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] PATH_INFO: `/v3/projects/12ec3acac95b438dafc350d45909b8ec/users/0f3e4bd2a5af4cb8a2c29e008f1ea3e0/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.169223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ec3acac95b438dafc350d45909b8ec, user_id=0f3e4bd2a5af4cb8a2c29e008f1ea3e0, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.172055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.190988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ccc9-858e-4daf-a56b-ae6dfde4aaa5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.204309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1036/2097] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:59 2022] PUT /identity/v3/projects/12ec3acac95b438dafc350d45909b8ec/users/0f3e4bd2a5af4cb8a2c29e008f1ea3e0/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:59.205988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.221717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:59.353955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.354752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.355258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.356045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.357406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.360229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.382246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1062/2098] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:19:59.391036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e488b-c6d2-4f59-8272-7f795803f085 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.395448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.407045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.407573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735b56-b3a4-4ccd-8aac-3a1a2cb016ac admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.408112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.408462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.408909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] PATH_INFO: `/v3/users/982b9871afeb487bbadadf0ca526a3a8` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.410299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982b9871afeb487bbadadf0ca526a3a8)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.412317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.415148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58029e-40a6-4065-8815-03a74c5afc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.416033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58029e-40a6-4065-8815-03a74c5afc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.417076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58029e-40a6-4065-8815-03a74c5afc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.417409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58029e-40a6-4065-8815-03a74c5afc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.418496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58029e-40a6-4065-8815-03a74c5afc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.420832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58029e-40a6-4065-8815-03a74c5afc8d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.580247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1063/2099] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:19:59 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:19:59.585382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.585695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.586017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.625656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] MFA Rules not processed for user `0f3e4bd2a5af4cb8a2c29e008f1ea3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:19:59.627272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:59.678962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982b9871afeb487bbadadf0ca526a3a8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:59.679691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982b9871afeb487bbadadf0ca526a3a8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:59.702269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982b9871afeb487bbadadf0ca526a3a8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:59.729656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982b9871afeb487bbadadf0ca526a3a8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:59.730582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982b9871afeb487bbadadf0ca526a3a8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:19:59.759836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1064/2100] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:19:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:19:59.759836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.844417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417f560-3e35-4c39-a6a5-6d8dcc49438f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.849703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.850931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.851135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.856186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] PATH_INFO: `/v3/projects/91a78ceb8d664903bc86981f6d2bdf1a/users/61672470041c4c688443769465661edb/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.860339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1037/2101] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:19:59 2022] DELETE /identity/v3/users/982b9871afeb487bbadadf0ca526a3a8 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:59.861381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.863399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:19:59.872378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a78ceb8d664903bc86981f6d2bdf1a, user_id=61672470041c4c688443769465661edb, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.876468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.936521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf50bcf-dec2-41db-ac33-c2f82f4feaa6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:19:59.942539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709ce8e-6ac1-4a89-b299-6440ee8c4f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:19:59.942539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ce8e-6ac1-4a89-b299-6440ee8c4f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:19:59.942539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ce8e-6ac1-4a89-b299-6440ee8c4f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:19:59.942539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ce8e-6ac1-4a89-b299-6440ee8c4f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:19:59.943249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709ce8e-6ac1-4a89-b299-6440ee8c4f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:19:59.945260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709ce8e-6ac1-4a89-b299-6440ee8c4f66 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:19:59.968149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1065/2102] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:19:59 2022] PUT /identity/v3/projects/91a78ceb8d664903bc86981f6d2bdf1a/users/61672470041c4c688443769465661edb/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:19:59.968948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:19:59.970872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.047067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1038/2103] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:19:59 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:00.048771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf7408-2cc8-4d3a-bc49-17b522a11b45 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.049060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf7408-2cc8-4d3a-bc49-17b522a11b45 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.049341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf7408-2cc8-4d3a-bc49-17b522a11b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.072922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-35bf7408-2cc8-4d3a-bc49-17b522a11b45 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:00.073142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d08b-3328-4fe5-a620-ee220e61ffc2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:00.077556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-35bf7408-2cc8-4d3a-bc49-17b522a11b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.083156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:00.083156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.085801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.086235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.090687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.156639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1039/2104] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:00.158256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.158739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.159169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.165937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:00.167550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:00.180839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1066/2105] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:19:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:00.181766 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:00.197105 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139df57a-c270-4720-bfc8-a03a09075b8b service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:00.212771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] MFA Rules not processed for user `61672470041c4c688443769465661edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:00.214001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.214832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:00.216786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.217070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.217489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.218273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:00.220083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:00.250145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1067/2106] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:00.250742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:00.264523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.333706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1040/2107] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:00.335325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:00.376903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902fa5-1ab1-40d3-bfd8-3cec0f43985d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:00.383872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:00.384671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.385021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.385370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.386238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:00.388065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:00.408239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1041/2108] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:00.412155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:00.413922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.439754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14c6e5-237f-4401-aa70-cbaf67ce0547 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:00.443607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca68fd-d2d3-4af4-a02d-05704fc41375 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:00.444769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:00.445542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.446518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.446518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.452008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f859-a6d3-440a-8efe-db0f7046a6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:00.452893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f859-a6d3-440a-8efe-db0f7046a6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.453818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f859-a6d3-440a-8efe-db0f7046a6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.453948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f859-a6d3-440a-8efe-db0f7046a6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.462440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:00.469219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:00.469363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f859-a6d3-440a-8efe-db0f7046a6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:00.469363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f859-a6d3-440a-8efe-db0f7046a6e6 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:00.481191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1068/2109] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:00.482200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:00.488624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1042/2110] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:00.491644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188b21d-8931-4e30-9077-9f45d96e1ed2 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:00.503363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:00.503363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.503708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.504248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] PATH_INFO: `/v3/projects/a4c5bc34168b4405ac9ccabd576fe4e6/users/ee9444c2727b4f4fbd21ce852b77debd/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.524079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c5bc34168b4405ac9ccabd576fe4e6, user_id=ee9444c2727b4f4fbd21ce852b77debd, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:00.527155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:00.611627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1069/2111] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:00 2022] PUT /identity/v3/projects/a4c5bc34168b4405ac9ccabd576fe4e6/users/ee9444c2727b4f4fbd21ce852b77debd/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:00.625494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:00.626376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:00.628284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:00.673698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] MFA Rules not processed for user `ee9444c2727b4f4fbd21ce852b77debd`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:00.675383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:00.785023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1043/2112] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:01.286867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:01.294786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:01.413859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:01.447886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9d19-568f-469a-938e-9890ef1813f9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:01.485380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:01.487146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:01.489957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:01.490828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] PATH_INFO: `/v3/projects/6dc8dcb544504ac8a63066732232d6df` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:01.496658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc8dcb544504ac8a63066732232d6df)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:01.502526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:01.540403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c4b5e-037c-4772-a944-c06cf34b2010 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:01.550689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:01.551356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:01.553424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:01.553424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:01.575620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:01.577373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:01.589554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1044/2113] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:01.629770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:01.661238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be285cc-03c6-4afd-9bb7-e2a2329255d6 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:01.677375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc8dcb544504ac8a63066732232d6df', 'request_id': 'req-51de58f6-0192-4a64-a899-79d2d3644c63'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:01.693791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc8dcb544504ac8a63066732232d6df', 'request_id': 'req-51de58f6-0192-4a64-a899-79d2d3644c63'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:01.800845 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc8dcb544504ac8a63066732232d6df', 'request_id': 'req-51de58f6-0192-4a64-a899-79d2d3644c63'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:01.805613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:01.806822 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:01.807259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:01.807684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] PATH_INFO: `/v3/users/ee9444c2727b4f4fbd21ce852b77debd` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:01.811587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9444c2727b4f4fbd21ce852b77debd)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:01.814363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:01.860709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] The token cache is being invalidate because project 6dc8dcb544504ac8a63066732232d6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:01.865042 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:01.870651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:01.875012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1070/2114] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:01 2022] DELETE /identity/v3/projects/6dc8dcb544504ac8a63066732232d6df => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:01.875012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:01.881942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:01.975787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de58f6-0192-4a64-a899-79d2d3644c63 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:01.982385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:01.983076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:01.983359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:01.983637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:01.985525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:02.071400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:02.073672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:02.094861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1071/2115] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:02.098726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:02.099926 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:02.114849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9444c2727b4f4fbd21ce852b77debd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.114849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9444c2727b4f4fbd21ce852b77debd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.120332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa6fdb-b1b7-43be-8daa-a35e23bcb0d8 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:02.126942 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:02.131213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:02.131213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:02.131213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] PATH_INFO: `/v3/users/f91f7af8d228483db19f10119855129b` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:02.131213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91f7af8d228483db19f10119855129b)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:02.132316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:02.136154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9444c2727b4f4fbd21ce852b77debd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.155696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9444c2727b4f4fbd21ce852b77debd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.156584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9df90b69-ff87-4e3e-bc14-a787b21594ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9444c2727b4f4fbd21ce852b77debd'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.292444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1045/2116] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:01 2022] DELETE /identity/v3/users/ee9444c2727b4f4fbd21ce852b77debd => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:02.298549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:02.299107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:02.299390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:02.340878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:02.342248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:02.410628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91f7af8d228483db19f10119855129b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.484994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1046/2117] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:02.490774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91f7af8d228483db19f10119855129b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.496661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:02.499764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:02.500743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91f7af8d228483db19f10119855129b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.546953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91f7af8d228483db19f10119855129b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.547728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e8d13c1e-3599-4422-8f34-20b9f884c081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91f7af8d228483db19f10119855129b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:02.559624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1072/2118] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:02 2022] DELETE /identity/v3/users/f91f7af8d228483db19f10119855129b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:02.613490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e02d-92bd-4ed8-a587-95f88efca54d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:02.728398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:02.729337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:02.729740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:02.731582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:02.743390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:02.938772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:02.944648 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:02.965142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1047/2119] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:03.426954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04017-cc20-4194-8157-3e45857f5fcd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:03.427855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04017-cc20-4194-8157-3e45857f5fcd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:03.428302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b04017-cc20-4194-8157-3e45857f5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:03.471822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d7b04017-cc20-4194-8157-3e45857f5fcd None None] MFA Rules not processed for user `e192d9ed33cc4852b691f9278242fdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:03.473314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d7b04017-cc20-4194-8157-3e45857f5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:03.580376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:03.582759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:03.609782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e244e-9770-43ea-b25c-2e7092cefbf0 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:03.619482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1073/2120] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:03.622817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:03.623958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:03.624244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:03.624522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] PATH_INFO: `/v3/projects/44f7b4d7b240485aad43e73add2184bd` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:03.625863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f7b4d7b240485aad43e73add2184bd)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:03.628327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:03.632124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:03.632492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:03.633029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:03.660260 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] MFA Rules not processed for user `e192d9ed33cc4852b691f9278242fdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:03.662452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:03.670957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1074/2121] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:03.684765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:03.686366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:03.749356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f7b4d7b240485aad43e73add2184bd', 'request_id': 'req-75ec518b-841b-471c-abb4-c7b1ad656793'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:03.755981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f7b4d7b240485aad43e73add2184bd', 'request_id': 'req-75ec518b-841b-471c-abb4-c7b1ad656793'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:03.775338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f79d-e0c8-4f31-b023-0d11349e0200 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:03.840721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f7b4d7b240485aad43e73add2184bd', 'request_id': 'req-75ec518b-841b-471c-abb4-c7b1ad656793'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:03.853425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b339976-4f90-41c2-87d8-b0aec145100a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:03.853425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339976-4f90-41c2-87d8-b0aec145100a service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:03.853425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339976-4f90-41c2-87d8-b0aec145100a service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:03.854014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b339976-4f90-41c2-87d8-b0aec145100a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:03.865306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] The token cache is being invalidate because project 44f7b4d7b240485aad43e73add2184bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:03.865797 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:03.867012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:03.874418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1048/2122] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:03 2022] DELETE /identity/v3/projects/44f7b4d7b240485aad43e73add2184bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:03.875460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:03.876910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:03.921747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339976-4f90-41c2-87d8-b0aec145100a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:03.923582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b339976-4f90-41c2-87d8-b0aec145100a service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:03.938340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1075/2123] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:03.941401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a259d-ff91-44b1-9443-7b01109207de None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:03.941764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a259d-ff91-44b1-9443-7b01109207de None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:03.942142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a259d-ff91-44b1-9443-7b01109207de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:03.958881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec518b-841b-471c-abb4-c7b1ad656793 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:03.966527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:03.967536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:03.967952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:03.968287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] PATH_INFO: `/v3/projects/a4c5bc34168b4405ac9ccabd576fe4e6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:03.969576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c5bc34168b4405ac9ccabd576fe4e6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:03.972037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:03.991114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-427a259d-ff91-44b1-9443-7b01109207de None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:03.992434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-427a259d-ff91-44b1-9443-7b01109207de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.003441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1076/2124] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:04.014180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.014180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.014180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.042446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:04.042446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.050430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1077/2125] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:04.056018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.068955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbaf6-9947-48f3-aa70-bf969fc3060c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.075809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.076519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.076804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.077078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.077837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:04.078169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.081312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.105173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1078/2126] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:20:04.106957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.115958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c5bc34168b4405ac9ccabd576fe4e6', 'request_id': 'req-64c46045-0190-4dc2-9406-de739eaebfee'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.117694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aeb35-8136-470b-9bdb-e955f4294e6c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.127869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c5bc34168b4405ac9ccabd576fe4e6', 'request_id': 'req-64c46045-0190-4dc2-9406-de739eaebfee'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.188962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.189632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.189916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.190360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.190933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.192956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.203498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c5bc34168b4405ac9ccabd576fe4e6', 'request_id': 'req-64c46045-0190-4dc2-9406-de739eaebfee'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.223220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] The token cache is being invalidate because project a4c5bc34168b4405ac9ccabd576fe4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:04.223487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.228503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-64c46045-0190-4dc2-9406-de739eaebfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.228503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1049/2127] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:03 2022] DELETE /identity/v3/projects/a4c5bc34168b4405ac9ccabd576fe4e6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:04.234169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179695a-cb35-4cde-8e20-9b1b53435cdd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.234169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179695a-cb35-4cde-8e20-9b1b53435cdd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.234169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179695a-cb35-4cde-8e20-9b1b53435cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.257953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9179695a-cb35-4cde-8e20-9b1b53435cdd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:04.257953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9179695a-cb35-4cde-8e20-9b1b53435cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.267205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1050/2128] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:04.283702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.283702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.283702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.312114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:04.313558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.335921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1051/2129] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:04.335921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.335921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.336236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1079/2130] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:04.339530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.344161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dbf7-3b69-497d-928f-08ee03403fa9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.445790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.446788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.447146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.447631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] PATH_INFO: `/v3/users/61672470041c4c688443769465661edb` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.449001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61672470041c4c688443769465661edb)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.452527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.466512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4e92-7f43-41d0-b2b7-a44083d95890 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.471197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.471890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.472210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.472483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.473696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:04.473696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.475221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.488130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1080/2131] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:20:04.489036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.492620 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.511044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709ba9d-f6ab-45ff-b9c6-560915324aca admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.516955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.518176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.518603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.519168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.520391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.523297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.653600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61672470041c4c688443769465661edb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.657158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61672470041c4c688443769465661edb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.672852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1081/2132] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:04.673635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61672470041c4c688443769465661edb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.675526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.690411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61672470041c4c688443769465661edb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.690668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c8139-8dbd-41a9-bd77-b9d2691168cc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.691401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61672470041c4c688443769465661edb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:04.695791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cfa0d-6620-4b1d-aa2f-2fa28beb8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.696464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cfa0d-6620-4b1d-aa2f-2fa28beb8116 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.696752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cfa0d-6620-4b1d-aa2f-2fa28beb8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.697033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cfa0d-6620-4b1d-aa2f-2fa28beb8116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.697741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cfa0d-6620-4b1d-aa2f-2fa28beb8116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.702169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cfa0d-6620-4b1d-aa2f-2fa28beb8116 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.788820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1052/2133] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:04 2022] DELETE /identity/v3/users/61672470041c4c688443769465661edb => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:04.790005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.792213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.821458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1082/2134] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:04.823004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.826457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.827182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.854669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:04.856921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.893485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d40ea-ae11-4147-97a6-4dd67eebc555 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.945667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1083/2135] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:04.945667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:04.948514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:04.973439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2afd-eea5-4062-a882-d703dce1b2c8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:04.979762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.981299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.982495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:04.983250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:04.984621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:04.986838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:04.998088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571b950-dd8b-4efa-8a9b-6f3a48e7464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:04.999347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b950-dd8b-4efa-8a9b-6f3a48e7464e admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:04.999881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b950-dd8b-4efa-8a9b-6f3a48e7464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.000350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571b950-dd8b-4efa-8a9b-6f3a48e7464e admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.001422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571b950-dd8b-4efa-8a9b-6f3a48e7464e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.004540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571b950-dd8b-4efa-8a9b-6f3a48e7464e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.018405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1053/2136] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:05.021154 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.021501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.021866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.046419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] MFA Rules not processed for user `e192d9ed33cc4852b691f9278242fdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:05.048010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:05.097217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1084/2137] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:04 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:05.101599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.103832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:05.126459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1054/2138] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:05.130537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.146291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d1ecc-e52f-438a-90fc-68ae375b133a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.151283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.156675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.156675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.156675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.156675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.157395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.178083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1055/2139] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:05.179552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.192799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401225-1e5c-4a68-83b6-559bed532bfe admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.194919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb1af2-d7a4-4d5e-abe8-4a15c58109da admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.198231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.198873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.199272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.200050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.202425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.203255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.203682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.203969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.208603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.210414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.217124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.219163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.225865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1056/2140] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:05.227386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.237275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1085/2141] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:05.238347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.243167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb626e-7ca3-41e1-8df9-c846a01dfbe3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.255309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6accac-0d51-4c7a-881c-250652f52f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.255694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120f39d-689c-48d9-a5c3-b0a524016ef7 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.256282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6accac-0d51-4c7a-881c-250652f52f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.256557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6accac-0d51-4c7a-881c-250652f52f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.256833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6accac-0d51-4c7a-881c-250652f52f35 admin admin] PATH_INFO: `/v3/projects/02c2540672d040efbcc5095599610de9/users/528c7e6de8f143409cfcf55db1ae1555/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.260888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.261589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.262008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.262676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.262975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.264853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.279218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1086/2142] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:05.281213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6accac-0d51-4c7a-881c-250652f52f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c2540672d040efbcc5095599610de9, user_id=528c7e6de8f143409cfcf55db1ae1555, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.284843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6accac-0d51-4c7a-881c-250652f52f35 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.290448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.305193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d8fb-bfeb-479e-8035-e0f9be4a94bb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.314229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e55fbe-aa69-421b-a383-611309661233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.315467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55fbe-aa69-421b-a383-611309661233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.315822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55fbe-aa69-421b-a383-611309661233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.316410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55fbe-aa69-421b-a383-611309661233 admin admin] PATH_INFO: `/v3/projects/1b1380ca67b048abbc3a1758ba8f9e69/users/ae85d30f57d34d2fbab51289789c44a0/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.341226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e55fbe-aa69-421b-a383-611309661233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1380ca67b048abbc3a1758ba8f9e69, user_id=ae85d30f57d34d2fbab51289789c44a0, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.345844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e55fbe-aa69-421b-a383-611309661233 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.353182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1057/2143] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:05 2022] PUT /identity/v3/projects/02c2540672d040efbcc5095599610de9/users/528c7e6de8f143409cfcf55db1ae1555/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:05.364100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.364433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.365086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.430276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] MFA Rules not processed for user `528c7e6de8f143409cfcf55db1ae1555`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:05.432160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:05.435498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1087/2144] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:05 2022] PUT /identity/v3/projects/1b1380ca67b048abbc3a1758ba8f9e69/users/ae85d30f57d34d2fbab51289789c44a0/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:05.450439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.451005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.452811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.492467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] MFA Rules not processed for user `ae85d30f57d34d2fbab51289789c44a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:05.494492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:05.595780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1058/2145] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:05.600463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.646265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1088/2146] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:05.657812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:05.661602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:05.797096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff3dc5-1a29-4fff-8d60-f9eececfea43 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.807762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.812924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.813236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.813518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.821415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9211a-ee1f-4b90-8b41-d8a9cb67eeeb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:05.822232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.826357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.830582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:05.836025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:05.836025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:05.836025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:05.856133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:05.858875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:05.889219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1089/2147] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:06.043146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:06.044923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:06.050629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1059/2148] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:05 2022] POST /identity/v3/projects => generated 367 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:06.052080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:06.082988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e0f8-a96c-4a27-9ba9-6046d5d314eb service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:06.157384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e288d-e8de-4519-9593-326f1a07c7f4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:06.162458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:06.163147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.163610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.163889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.164434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:06.164590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:06.165378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.165652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.165932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] PATH_INFO: `/v3/projects/91a78ceb8d664903bc86981f6d2bdf1a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.166666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:06.167686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a78ceb8d664903bc86981f6d2bdf1a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:06.170734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:06.293602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1060/2149] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:06 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:06.295786 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:06.320879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a747e5-867e-4e15-a128-974d92856932 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:06.387486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a78ceb8d664903bc86981f6d2bdf1a', 'request_id': 'req-153e19f2-0404-4582-9b02-21ba5cd24134'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:06.440293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a78ceb8d664903bc86981f6d2bdf1a', 'request_id': 'req-153e19f2-0404-4582-9b02-21ba5cd24134'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:06.493882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:06.494953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.495244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.495829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.510397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:06.520615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:06.538212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a78ceb8d664903bc86981f6d2bdf1a', 'request_id': 'req-153e19f2-0404-4582-9b02-21ba5cd24134'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:06.568024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1061/2150] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:06.568281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] The token cache is being invalidate because project 91a78ceb8d664903bc86981f6d2bdf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:06.568281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:06.569156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-153e19f2-0404-4582-9b02-21ba5cd24134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:06.569366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:06.571719 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:06.573119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1090/2151] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:06 2022] DELETE /identity/v3/projects/91a78ceb8d664903bc86981f6d2bdf1a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:06.589184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108f720-ffe5-480d-9ced-aaad87a0e51a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.589184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108f720-ffe5-480d-9ced-aaad87a0e51a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.589184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108f720-ffe5-480d-9ced-aaad87a0e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.595832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7313c0d-2c05-43cc-b3f2-a59f120aa21c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:06.602811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:06.603730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.606873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.621150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] PATH_INFO: `/v3/projects/078e14d6b00f4dd29f9a1d18c3726e4b/users/0bd653ce855145a7ac6f5d24c9a6ced9/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.627837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8108f720-ffe5-480d-9ced-aaad87a0e51a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:06.630224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8108f720-ffe5-480d-9ced-aaad87a0e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:06.646124 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1091/2152] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:06.655053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.655328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.655611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.662763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e14d6b00f4dd29f9a1d18c3726e4b, user_id=0bd653ce855145a7ac6f5d24c9a6ced9, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:06.665759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:06.689053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:06.690556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:06.703950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1092/2153] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:06.706063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:06.717110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2721-fa88-4dd3-b30a-1ae3eb19b8ae None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:06.722079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:06.722832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.723118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.723401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.724140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:06.724458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:06.726085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:06.745157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1093/2154] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:06.757464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:06.785815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4322-9046-4dd5-91ef-ee825a45bee5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:06.820837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1062/2155] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:06 2022] PUT /identity/v3/projects/078e14d6b00f4dd29f9a1d18c3726e4b/users/0bd653ce855145a7ac6f5d24c9a6ced9/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:06.822237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:06.822237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:06.822237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:06.822237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:06.825980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:06.830041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:06.836695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.024893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1094/2156] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:06 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:07.025528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7138db-b4c3-4ed7-86de-53b06f7ef9c6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.025822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.113360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.113920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.114558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.114842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.115616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.117586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.135976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1063/2157] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:07.138206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.151100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63faa7-227b-4521-93fb-c777c2888cc5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.157761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98e368-f791-464c-bbde-7d227b7f1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.158688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98e368-f791-464c-bbde-7d227b7f1402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.159316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98e368-f791-464c-bbde-7d227b7f1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.159690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98e368-f791-464c-bbde-7d227b7f1402 admin admin] PATH_INFO: `/v3/projects/078e14d6b00f4dd29f9a1d18c3726e4b/users/0bd653ce855145a7ac6f5d24c9a6ced9/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.168933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98e368-f791-464c-bbde-7d227b7f1402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e14d6b00f4dd29f9a1d18c3726e4b, user_id=0bd653ce855145a7ac6f5d24c9a6ced9, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.173757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98e368-f791-464c-bbde-7d227b7f1402 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.193636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1064/2158] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:07 2022] PUT /identity/v3/projects/078e14d6b00f4dd29f9a1d18c3726e4b/users/0bd653ce855145a7ac6f5d24c9a6ced9/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:07.203076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374421f-47fc-433b-a7b0-2e67d820efbd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.205617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.205930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.206251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.251385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] MFA Rules not processed for user `0bd653ce855145a7ac6f5d24c9a6ced9`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:07.253753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:07.306428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.307379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.307751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.308146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.309034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.311256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.389964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1065/2159] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:07.409504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.410987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:07.446622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1095/2160] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:07 2022] POST /identity/v3/users => generated 287 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:07.450891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.478745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedad1ca-c5ff-4d06-a470-bd469a9014fe admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.487680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.488816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.489313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.489935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.491286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.493135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.506676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1096/2161] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:07.511458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.524144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18603a-071c-4e53-88a8-15f3033584e4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.529815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.530664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.531023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.531530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.532283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.534081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.546570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1097/2162] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:07.547232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db90c62-2292-40f5-b4cb-7cd6e9eb9599 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.550673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:07.554022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1adc3-9c2d-41d9-9f4a-ec49e5754bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.556873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1adc3-9c2d-41d9-9f4a-ec49e5754bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.556873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1adc3-9c2d-41d9-9f4a-ec49e5754bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.557705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1adc3-9c2d-41d9-9f4a-ec49e5754bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.562891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377cddf-b7a0-4fb1-8824-3b51365d49d5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:07.568057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:07.568973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.569256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.569613 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] PATH_INFO: `/v3/projects/727467f6f2c24376b3b198ae11ca1b1e/users/a850280698764ec0912d836d045a3e82/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.582525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1adc3-9c2d-41d9-9f4a-ec49e5754bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.585473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1adc3-9c2d-41d9-9f4a-ec49e5754bf3 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.598986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1066/2163] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:07.599255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] RBAC: Authorizing `identity:create_grant(project_id=727467f6f2c24376b3b198ae11ca1b1e, user_id=a850280698764ec0912d836d045a3e82, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:07.604083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:07.846095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1098/2164] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:07 2022] PUT /identity/v3/projects/727467f6f2c24376b3b198ae11ca1b1e/users/a850280698764ec0912d836d045a3e82/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:07.857510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:07.858431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:07.859022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:07.921011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] MFA Rules not processed for user `a850280698764ec0912d836d045a3e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:07.922299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:08.039992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1067/2165] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:08.380305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:08.475764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:08.477155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:08.492431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683bc9-3ff1-4e5f-aa49-3adbdc9abeae admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:08.499724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:08.500638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:08.501033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:08.501898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:08.506533 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446155d-5ae3-43c8-8681-cfc716152c37 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:08.517385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:08.517979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:08.518301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:08.518581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:08.520204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:08.522010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:08.524868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:08.539073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1099/2166] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:08.642213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:08.643981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192d5e8-3e8c-40ff-bedb-8ae08a3b4949 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:08.673301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1068/2167] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:10.104307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:10.114275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636279-9ef5-4a2d-9234-749cfa5c7c1a service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:10.119092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:10.120000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:10.120122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:10.120296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:10.122938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:10.192384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:10.193982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:10.204689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1100/2168] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:10.786047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0cb-1ff5-483b-820b-472ad20b2a95 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:10.787198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0cb-1ff5-483b-820b-472ad20b2a95 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:10.787699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0cb-1ff5-483b-820b-472ad20b2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:10.813098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-49fbc0cb-1ff5-483b-820b-472ad20b2a95 None None] MFA Rules not processed for user `a850280698764ec0912d836d045a3e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:10.820746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-49fbc0cb-1ff5-483b-820b-472ad20b2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:10.825674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1069/2169] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:17.100493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:17.103172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:17.260983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf5199-b688-42ca-8514-0326da1bae54 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:17.267353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:17.268752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:17.269039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:17.269462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] PATH_INFO: `/v3/users/69cdd1f6055e4b018bc5aff013998ba6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:17.271067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cdd1f6055e4b018bc5aff013998ba6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:17.273027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:17.517272 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cdd1f6055e4b018bc5aff013998ba6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:17.585676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cdd1f6055e4b018bc5aff013998ba6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:17.596097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cdd1f6055e4b018bc5aff013998ba6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:17.617846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cdd1f6055e4b018bc5aff013998ba6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:17.618798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cdd1f6055e4b018bc5aff013998ba6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:17.626085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1101/2170] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:17 2022] DELETE /identity/v3/users/69cdd1f6055e4b018bc5aff013998ba6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:17.634559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:17.635604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:17.635880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:17.660454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:17.661987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:17.776785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1070/2171] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:17.800223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:17.801978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:17.900632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff694242-df6c-439e-8205-114161aa5315 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:17.906211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:17.906964 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:17.907314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:17.907679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:17.929740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:17.931868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:17.946231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1102/2172] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:18.342419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:18.344206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:18.358340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3afd82-a213-413b-9ada-79af8106f029 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:18.371290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:18.372290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:18.372651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:18.373278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] PATH_INFO: `/v3/users/528c7e6de8f143409cfcf55db1ae1555` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:18.374857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=528c7e6de8f143409cfcf55db1ae1555)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:18.377095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:18.695259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:18.696722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:18.710276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204118-73fe-42f6-ab78-012359bc1d9c service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:18.715701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:18.716960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:18.717244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:18.717516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] PATH_INFO: `/v3/projects/058fc45260564648a1cdcfa4c839d1ec` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:18.718759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=058fc45260564648a1cdcfa4c839d1ec)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:18.720654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:18.772390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528c7e6de8f143409cfcf55db1ae1555'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:18.773173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528c7e6de8f143409cfcf55db1ae1555'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:18.781684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528c7e6de8f143409cfcf55db1ae1555'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:18.795000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528c7e6de8f143409cfcf55db1ae1555'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:18.795731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ddfeb031-e28f-4c79-ab1c-aa0c7ea90bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528c7e6de8f143409cfcf55db1ae1555'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.115807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1071/2173] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:18 2022] DELETE /identity/v3/users/528c7e6de8f143409cfcf55db1ae1555 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:19.120615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:19.120937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:19.121218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:19.128470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058fc45260564648a1cdcfa4c839d1ec', 'request_id': 'req-b9f2a35c-b808-45bc-807b-a72b777e2d4b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.135108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058fc45260564648a1cdcfa4c839d1ec', 'request_id': 'req-b9f2a35c-b808-45bc-807b-a72b777e2d4b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.144591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:19.146206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:19.211981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1072/2174] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:19.224359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:19.225764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:19.255234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058fc45260564648a1cdcfa4c839d1ec', 'request_id': 'req-b9f2a35c-b808-45bc-807b-a72b777e2d4b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.269294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] The token cache is being invalidate because project 058fc45260564648a1cdcfa4c839d1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:19.269702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.270533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.274668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1103/2175] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:18 2022] DELETE /identity/v3/projects/058fc45260564648a1cdcfa4c839d1ec => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:19.283225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:19.284720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:19.320321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90300-9598-448b-b0a1-6ca8f93148fd None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:19.328063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:19.329087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:19.329577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:19.330378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:19.333526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:19.355449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:19.357349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:19.374321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1073/2176] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:19.381782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2a35c-b808-45bc-807b-a72b777e2d4b admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:19.403072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:19.405372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:19.405884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:19.406532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] PATH_INFO: `/v3/users/87164afb5923487c91fe2c3621f75bd4` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:19.407921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87164afb5923487c91fe2c3621f75bd4)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:19.411018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:19.736539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87164afb5923487c91fe2c3621f75bd4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.898011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87164afb5923487c91fe2c3621f75bd4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.906330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87164afb5923487c91fe2c3621f75bd4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.918391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87164afb5923487c91fe2c3621f75bd4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.919415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87164afb5923487c91fe2c3621f75bd4'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:19.925352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1104/2177] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:19 2022] DELETE /identity/v3/users/87164afb5923487c91fe2c3621f75bd4 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:19.972726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:19.972726 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:19.988806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc9f5-6a4a-4d61-984d-a6f1485d4c38 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:20.086601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:20.087614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:20.087965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:20.088310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] PATH_INFO: `/v3/projects/02c2540672d040efbcc5095599610de9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:20.089623 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c2540672d040efbcc5095599610de9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:20.091754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:20.205664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c2540672d040efbcc5095599610de9', 'request_id': 'req-52bddbac-f9ae-414f-bbf0-eba071b97060'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.211829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c2540672d040efbcc5095599610de9', 'request_id': 'req-52bddbac-f9ae-414f-bbf0-eba071b97060'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.288681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c2540672d040efbcc5095599610de9', 'request_id': 'req-52bddbac-f9ae-414f-bbf0-eba071b97060'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.302475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] The token cache is being invalidate because project 02c2540672d040efbcc5095599610de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:20.302767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.303894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.305028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1074/2178] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:19 2022] DELETE /identity/v3/projects/02c2540672d040efbcc5095599610de9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:20.309062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:20.311146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:20.324270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c418db-ad27-4e8e-8596-974c8a082104 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:20.371817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:20.374956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:20.416159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:20.417303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:20.417979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:20.417979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] PATH_INFO: `/v3/users/0bd653ce855145a7ac6f5d24c9a6ced9` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:20.420128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd653ce855145a7ac6f5d24c9a6ced9)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:20.422339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:20.485961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bddbac-f9ae-414f-bbf0-eba071b97060 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:20.491338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:20.492268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:20.492637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:20.493512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] PATH_INFO: `/v3/users/ae85d30f57d34d2fbab51289789c44a0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:20.494742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae85d30f57d34d2fbab51289789c44a0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:20.496729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:20.654602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd653ce855145a7ac6f5d24c9a6ced9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.738576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd653ce855145a7ac6f5d24c9a6ced9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.740122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae85d30f57d34d2fbab51289789c44a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.741466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae85d30f57d34d2fbab51289789c44a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.763841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd653ce855145a7ac6f5d24c9a6ced9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.764253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae85d30f57d34d2fbab51289789c44a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.780013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae85d30f57d34d2fbab51289789c44a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.780761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e434c21a-ebf2-47dd-8192-5c7c08d4adae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae85d30f57d34d2fbab51289789c44a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.795789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd653ce855145a7ac6f5d24c9a6ced9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.796610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd653ce855145a7ac6f5d24c9a6ced9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:20.803812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1105/2179] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:20 2022] DELETE /identity/v3/users/0bd653ce855145a7ac6f5d24c9a6ced9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:20.805569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:20.807475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:20.866530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1075/2180] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:20 2022] DELETE /identity/v3/users/ae85d30f57d34d2fbab51289789c44a0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:20.870561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:20.871030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:20.871422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:20.894340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:20.895698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:20.897713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc032bc-f242-4994-a513-18f92f338f32 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:20.970715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1076/2181] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:20.971050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:20.971998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:20.972280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:20.972557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] PATH_INFO: `/v3/projects/11846796cdde4e4f8834eac2f49394f7` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:20.973867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=11846796cdde4e4f8834eac2f49394f7)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:20.976748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:20.981487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:20.983922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:21.065473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849d38d-e4fc-46b4-b353-d03df90c58be None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:21.065473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:21.065473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:21.065473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:21.065835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:21.076217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:21.077713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:21.092573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1077/2182] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:21.142354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11846796cdde4e4f8834eac2f49394f7', 'request_id': 'req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.149350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11846796cdde4e4f8834eac2f49394f7', 'request_id': 'req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.235079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11846796cdde4e4f8834eac2f49394f7', 'request_id': 'req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.251716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] The token cache is being invalidate because project 11846796cdde4e4f8834eac2f49394f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:21.252014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.252867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.254531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1106/2183] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:20 2022] DELETE /identity/v3/projects/11846796cdde4e4f8834eac2f49394f7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:21.259300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:21.272190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b8102-9fa0-4de1-8fe0-ed544b64e428 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:21.283440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:21.290438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:21.357222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:21.358138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:21.358441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:21.358716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] PATH_INFO: `/v3/users/0f3e4bd2a5af4cb8a2c29e008f1ea3e0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:21.360009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3e4bd2a5af4cb8a2c29e008f1ea3e0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:21.362624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:21.396703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc91cf-d9a5-44c2-85e9-dce32c11d0ca admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:21.405825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:21.406867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:21.407155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:21.407437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] PATH_INFO: `/v3/projects/078e14d6b00f4dd29f9a1d18c3726e4b` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:21.409278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078e14d6b00f4dd29f9a1d18c3726e4b)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:21.411407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:21.632527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078e14d6b00f4dd29f9a1d18c3726e4b', 'request_id': 'req-0e5e3729-99ac-4e85-a821-ad3a12771cf9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.632817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3e4bd2a5af4cb8a2c29e008f1ea3e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.634136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3e4bd2a5af4cb8a2c29e008f1ea3e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.641116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078e14d6b00f4dd29f9a1d18c3726e4b', 'request_id': 'req-0e5e3729-99ac-4e85-a821-ad3a12771cf9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.645379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3e4bd2a5af4cb8a2c29e008f1ea3e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.661837 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3e4bd2a5af4cb8a2c29e008f1ea3e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.662858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7b219bc9-bd5e-4f80-a5e6-1dce844c6433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3e4bd2a5af4cb8a2c29e008f1ea3e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.709735 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078e14d6b00f4dd29f9a1d18c3726e4b', 'request_id': 'req-0e5e3729-99ac-4e85-a821-ad3a12771cf9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.726541 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] The token cache is being invalidate because project 078e14d6b00f4dd29f9a1d18c3726e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:21.726849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.727754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:21.729392 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1107/2184] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:21 2022] DELETE /identity/v3/projects/078e14d6b00f4dd29f9a1d18c3726e4b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:21.730409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:21.736192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:21.776731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1078/2185] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:21 2022] DELETE /identity/v3/users/0f3e4bd2a5af4cb8a2c29e008f1ea3e0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:21.778542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2ac9-f18b-4c16-89c2-1af630723f5b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:21.779223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2ac9-f18b-4c16-89c2-1af630723f5b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:21.779931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2ac9-f18b-4c16-89c2-1af630723f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:21.814578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e3729-99ac-4e85-a821-ad3a12771cf9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:21.816267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7b8c2ac9-f18b-4c16-89c2-1af630723f5b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:21.832069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7b8c2ac9-f18b-4c16-89c2-1af630723f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:21.896608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:21.898088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:21.898662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:21.899171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] PATH_INFO: `/v3/projects/1b1380ca67b048abbc3a1758ba8f9e69` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:21.901088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1380ca67b048abbc3a1758ba8f9e69)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:21.904114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:21.942008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1079/2186] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:21.950407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:21.950869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:21.951448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:21.973585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:21.975206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:21.990307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1080/2187] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:21.995123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.007681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33a32-210a-4752-ae51-a1dc8f05a30f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.016574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.017313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.017594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.017871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.018662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:22.020023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.021729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.037211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1081/2188] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:20:22.042287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.055492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2498fc1-77ea-4d7a-bf27-67a01b8bc3b8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.080494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.080494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.080494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.080494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.080982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.080982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.085290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1380ca67b048abbc3a1758ba8f9e69', 'request_id': 'req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.094375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1380ca67b048abbc3a1758ba8f9e69', 'request_id': 'req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.191738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1380ca67b048abbc3a1758ba8f9e69', 'request_id': 'req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.205592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] The token cache is being invalidate because project 1b1380ca67b048abbc3a1758ba8f9e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:22.205882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.206748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e4cb95f1-3e83-4d75-ab3d-54eb811f4ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.208407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1108/2189] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:21 2022] DELETE /identity/v3/projects/1b1380ca67b048abbc3a1758ba8f9e69 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:22.214180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.214355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.214784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.238971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1082/2190] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:22.239171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:22.239171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.242120 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.243978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.329439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1109/2191] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:22.331277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.332721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.338484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420775b-8c73-4a64-b899-9a2bb79eacfd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.346669 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a374-b6ac-4c0e-bf4a-cf2432a99da4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.352420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.353629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.353887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.354197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] PATH_INFO: `/v3/projects/12ec3acac95b438dafc350d45909b8ec` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.355822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ec3acac95b438dafc350d45909b8ec)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.358079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.361790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e255d4-2b7c-4885-b98c-9cef5b4492cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.362684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e255d4-2b7c-4885-b98c-9cef5b4492cc admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.363303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e255d4-2b7c-4885-b98c-9cef5b4492cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.363981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e255d4-2b7c-4885-b98c-9cef5b4492cc admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.365036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e255d4-2b7c-4885-b98c-9cef5b4492cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.370327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e255d4-2b7c-4885-b98c-9cef5b4492cc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.494891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1083/2192] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:22.496397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.496759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.497153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.510292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ec3acac95b438dafc350d45909b8ec', 'request_id': 'req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.518981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ec3acac95b438dafc350d45909b8ec', 'request_id': 'req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.519232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:22.521259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.600696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1084/2193] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:22.601657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.608855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ec3acac95b438dafc350d45909b8ec', 'request_id': 'req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.615508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923828a-31d9-4dba-90cb-c05aee9b293e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.621215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9ef2-6d38-4a1f-b62d-376f6ad2002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.621896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9ef2-6d38-4a1f-b62d-376f6ad2002c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.622214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9ef2-6d38-4a1f-b62d-376f6ad2002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.622494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9ef2-6d38-4a1f-b62d-376f6ad2002c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.623516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa9ef2-6d38-4a1f-b62d-376f6ad2002c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.624194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] The token cache is being invalidate because project 12ec3acac95b438dafc350d45909b8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:22.624556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.625181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa9ef2-6d38-4a1f-b62d-376f6ad2002c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.625367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:22.627092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1110/2194] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:22 2022] DELETE /identity/v3/projects/12ec3acac95b438dafc350d45909b8ec => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:22.627945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.631707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.637471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1085/2195] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:22.644161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.644161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.644161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.645782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776f50-97f2-4eb2-98e3-1d88d0e6ad98 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.651690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.652387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.652671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.652951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.654377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:22.654826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.657017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fb5bc-abc0-4ae5-92c7-1a29e79a2cab admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.658335 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:22.659536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.676598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1086/2196] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:22.676598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.676812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1111/2197] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:22.678006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.678304 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.678607 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.678947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.692940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156647c-becb-488e-bbcd-7cff94a7b928 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.700681 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:22.702482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.702482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.702482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.705721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:22.705806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.705806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.706354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.715097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1112/2198] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:22.715097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.719789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1087/2199] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:22.720697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.723984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2880ff-9d8f-4ebd-be08-7fb37b7b8ecb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.730283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.731112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.731759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.732180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.733161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.735501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.736821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d584a-a55d-4b8a-ab5f-7bf8e68e581b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.747136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.747136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.747136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.747136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.747536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:22.747536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.749030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.766954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1088/2200] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:22.766954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.777123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e931d8-e335-4eab-8829-8ea951ed0e07 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.783973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.784927 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.785213 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.785577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] PATH_INFO: `/v3/projects/b5da957d126f4ceca6e037e4b1d24fe6/users/ec71104cb13e45459ebb4d8c222f0b6b/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.805938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5da957d126f4ceca6e037e4b1d24fe6, user_id=ec71104cb13e45459ebb4d8c222f0b6b, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.815082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.863439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1113/2201] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:22.864362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.892232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1089/2202] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:22 2022] PUT /identity/v3/projects/b5da957d126f4ceca6e037e4b1d24fe6/users/ec71104cb13e45459ebb4d8c222f0b6b/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:22.892963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:22.977284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417729-1f03-45b2-99d4-1159f80f9fdf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:22.983755 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea8f86-b7d5-45b8-ab01-a40779321ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:22.984680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8f86-b7d5-45b8-ab01-a40779321ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:22.985112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8f86-b7d5-45b8-ab01-a40779321ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:22.985531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8f86-b7d5-45b8-ab01-a40779321ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:22.986549 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea8f86-b7d5-45b8-ab01-a40779321ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:22.988787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea8f86-b7d5-45b8-ab01-a40779321ed3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:22.992952 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13e5f8-f960-4bdd-89b9-c2d5607055ff admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.001690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.003241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.004752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.006046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.006995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.011528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.079067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1114/2203] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/projects => generated 393 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:23.080576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.080920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.081318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.102410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1090/2204] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:22 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:23.102410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.110616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] MFA Rules not processed for user `ec71104cb13e45459ebb4d8c222f0b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:23.111952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:23.113962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394593dd-066a-4268-89df-ae6780f48718 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.177653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.178369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.178657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.178938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.179654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.181583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.189045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1115/2205] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:23.189045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.198128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2ef4f-79b9-4826-b4c3-8cf6f4b1aedc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.203550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.204218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.204503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.204783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.205829 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.207302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.218700 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1116/2206] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:23.219529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.229856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c622ae-a005-46fa-a215-4701250c017c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.236239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.236813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.237074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.237356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.238060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.240021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.276635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1091/2207] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:23 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:23.277370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.288323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0fc0a-10f5-4a9f-a3e7-9ce1d2980346 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.293256 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.293687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.294072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.294615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.295507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.297121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.312861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1092/2208] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:23.313803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.324155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3400d-8aa7-4841-9712-56956872018c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.329405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.330136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.330442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.330809 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.331548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.333187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.344721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1117/2209] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:23 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:23.344721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.349584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1093/2210] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:23.349584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.355976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2533-280e-4f1a-accc-f71b1d577d94 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.410142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ed6e-9238-4c23-a6ce-a747a45314ee admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.418445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.419815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.420196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.420483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] PATH_INFO: `/v3/projects/56ff3980419443e19b7ec0f9827ea35f/users/de35c5c0a4f44cb699c77a009ea717cf/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.439483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ff3980419443e19b7ec0f9827ea35f, user_id=de35c5c0a4f44cb699c77a009ea717cf, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.442424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.546031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1118/2211] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:23 2022] PUT /identity/v3/projects/56ff3980419443e19b7ec0f9827ea35f/users/de35c5c0a4f44cb699c77a009ea717cf/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:23.546951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.556592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.557274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.557555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.557830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.558575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.560675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.609628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67dc5-417b-4937-be4a-226b1711293f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.614477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7f6e8-26bb-417f-896a-98678cfdca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.615186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7f6e8-26bb-417f-896a-98678cfdca27 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.617608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7f6e8-26bb-417f-896a-98678cfdca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.617608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7f6e8-26bb-417f-896a-98678cfdca27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.617608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7f6e8-26bb-417f-896a-98678cfdca27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.618246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7f6e8-26bb-417f-896a-98678cfdca27 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.629968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1119/2212] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:23.631320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.631612 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.631890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.646304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1094/2213] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:23 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:23.646304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.657911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33724e-d3a6-4267-91aa-a875e5668e8b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.662416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] MFA Rules not processed for user `de35c5c0a4f44cb699c77a009ea717cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:23.663653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:23.665743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.666740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.669403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.669403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] PATH_INFO: `/v3/projects/cb1f1bc014d748398c72a1d1c6afe0c9/users/2b537465493148e48cdc5e1ff4321819/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.683933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1f1bc014d748398c72a1d1c6afe0c9, user_id=2b537465493148e48cdc5e1ff4321819, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.687483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.740954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1120/2214] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:23.740954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.750629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81bdcd-0412-4bfe-839b-47b69036e085 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.755711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.756605 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.756885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.757164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.757919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:23.759592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:23.773615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1121/2215] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:23.778790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.778790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:23.803439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1095/2216] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:23 2022] PUT /identity/v3/projects/cb1f1bc014d748398c72a1d1c6afe0c9/users/2b537465493148e48cdc5e1ff4321819/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:23.839619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:23.849198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6c8db-08c5-414d-84cf-3d93d55b1b9d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:23.912535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d822c1e-0045-4770-af15-ca8346361442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:23.913435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d822c1e-0045-4770-af15-ca8346361442 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:23.913865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d822c1e-0045-4770-af15-ca8346361442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:23.914535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d822c1e-0045-4770-af15-ca8346361442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:23.983508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce9f8-49dd-44b5-b044-7286c20ccf18 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.015161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.020733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.022216 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d822c1e-0045-4770-af15-ca8346361442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.022369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.023625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] PATH_INFO: `/v3/projects/6bac73f19ff1447a858267d0a06a7459/users/1df0ae054c8449bdb30bcdb6e9961e6d/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.023744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d822c1e-0045-4770-af15-ca8346361442 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.038480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1122/2217] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:24.039976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.040167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.040514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.074874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bac73f19ff1447a858267d0a06a7459, user_id=1df0ae054c8449bdb30bcdb6e9961e6d, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.084289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] MFA Rules not processed for user `2b537465493148e48cdc5e1ff4321819`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:24.085996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:24.087329 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.175040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1096/2218] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:23 2022] PUT /identity/v3/projects/6bac73f19ff1447a858267d0a06a7459/users/1df0ae054c8449bdb30bcdb6e9961e6d/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:24.180322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.210493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1123/2219] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:24.215505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.229210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95df7-0177-4754-88f4-e031f29d8f65 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.274874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9254de4-e56a-494a-bbff-e72f04b58adb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.282971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.283864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.284289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.284733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.285615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.292101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.299443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1097/2220] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:24.303542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.305526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.306266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.306580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.306856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.307601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.309784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.314613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435da610-e7f7-4d02-b75b-939e9b90bab5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.319454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710701-6aed-42be-92fb-74b026dff750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.320341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710701-6aed-42be-92fb-74b026dff750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.320617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710701-6aed-42be-92fb-74b026dff750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.320888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710701-6aed-42be-92fb-74b026dff750 admin admin] PATH_INFO: `/v3/projects/6bac73f19ff1447a858267d0a06a7459/users/1df0ae054c8449bdb30bcdb6e9961e6d/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.323135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710701-6aed-42be-92fb-74b026dff750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bac73f19ff1447a858267d0a06a7459, user_id=1df0ae054c8449bdb30bcdb6e9961e6d, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.327275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710701-6aed-42be-92fb-74b026dff750 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.339034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1098/2221] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:24 2022] PUT /identity/v3/projects/6bac73f19ff1447a858267d0a06a7459/users/1df0ae054c8449bdb30bcdb6e9961e6d/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:24.351783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.352074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.352529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.383151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] MFA Rules not processed for user `1df0ae054c8449bdb30bcdb6e9961e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:24.384378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:24.444977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1124/2222] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:24 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:24.449488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.472803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1099/2223] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:24.484754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.486368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:24.521842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486d35-5f42-4095-8474-1106bb07ba23 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.526984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.527661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.527946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.533077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.533077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.533077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.555773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399bf10-2dc4-4608-aab7-daa175e860ad None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.607358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.608097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.608450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.608721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.666585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1125/2224] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:24 2022] POST /identity/v3/users => generated 303 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:24.670916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.675505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.676961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.681685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a470c0-afce-434d-8dc1-d8929cbec20e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.688239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1100/2225] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:24.688606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.689395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.689752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.690040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.690825 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.692489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.704508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1126/2226] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:24.718889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.729778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e16e8-8cf5-4c04-88fd-87e279555fd5 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:24.735398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:24.736344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:24.736618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:24.736887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] PATH_INFO: `/v3/projects/51b347e988d641a1a935560ef4027644/users/030ea2137339492cbe9bfb2a1a2ae234/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:24.754611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b347e988d641a1a935560ef4027644, user_id=030ea2137339492cbe9bfb2a1a2ae234, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:24.757343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:24.904969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1101/2227] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:24 2022] PUT /identity/v3/projects/51b347e988d641a1a935560ef4027644/users/030ea2137339492cbe9bfb2a1a2ae234/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:24.909052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:24.920190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844690f-cd0f-46a7-b1e6-9a0865e543d4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:25.003191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6433152-9c17-4528-a928-b470326cafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:25.003873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433152-9c17-4528-a928-b470326cafe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:25.004156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433152-9c17-4528-a928-b470326cafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:25.004437 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6433152-9c17-4528-a928-b470326cafe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:25.005170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6433152-9c17-4528-a928-b470326cafe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:25.006986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6433152-9c17-4528-a928-b470326cafe2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:25.019275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1127/2228] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:25.024863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:25.036142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda582f-e816-4cc5-bc09-e4678a3ab28b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:25.041106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:25.045831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:25.045831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:25.045831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] PATH_INFO: `/v3/projects/51b347e988d641a1a935560ef4027644/users/030ea2137339492cbe9bfb2a1a2ae234/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:25.045831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b347e988d641a1a935560ef4027644, user_id=030ea2137339492cbe9bfb2a1a2ae234, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:25.048308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:25.059727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1102/2229] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:25 2022] PUT /identity/v3/projects/51b347e988d641a1a935560ef4027644/users/030ea2137339492cbe9bfb2a1a2ae234/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:25.074719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:25.075159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:25.075547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:25.118398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] MFA Rules not processed for user `030ea2137339492cbe9bfb2a1a2ae234`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:25.119643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:25.198687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1128/2230] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:25.210595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:25.280606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e4d10-d947-4bc3-ac81-0934726882ff admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:25.284484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:25.285174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:25.285445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:25.285714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:25.298089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:25.300486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:25.314016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1103/2231] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:25.370207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:25.380788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068f6f8-1819-4e71-b38e-3cdcbab06faf None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:25.385072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa823-6bf5-4f06-bf8d-803308250cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:25.385728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa823-6bf5-4f06-bf8d-803308250cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:25.386011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa823-6bf5-4f06-bf8d-803308250cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:25.386326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa823-6bf5-4f06-bf8d-803308250cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:25.457380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aa823-6bf5-4f06-bf8d-803308250cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:25.458900 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aa823-6bf5-4f06-bf8d-803308250cf5 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:25.469102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1129/2232] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:30.628199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:30.743991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a5da-a586-48df-8715-8040c14af437 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:30.750543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:30.751622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:30.751925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:30.752176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] PATH_INFO: `/v3/users/ec71104cb13e45459ebb4d8c222f0b6b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:30.753757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec71104cb13e45459ebb4d8c222f0b6b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:30.755839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:31.002723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec71104cb13e45459ebb4d8c222f0b6b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:31.003397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec71104cb13e45459ebb4d8c222f0b6b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:31.011115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec71104cb13e45459ebb4d8c222f0b6b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:31.024136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec71104cb13e45459ebb4d8c222f0b6b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:31.024899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec71104cb13e45459ebb4d8c222f0b6b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:31.151469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1104/2233] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:30 2022] DELETE /identity/v3/users/ec71104cb13e45459ebb4d8c222f0b6b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:31.153279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:31.154180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:31.154832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:31.186465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:31.188155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:31.289945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1130/2234] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:31.303888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:31.306035 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:31.448194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90037c64-404f-427d-af87-fcfbeebbc41a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:31.458655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:31.460626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:31.461236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:31.462006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:31.480647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:31.482185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:31.502492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1105/2235] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:31.836536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:31.839652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:31.875684 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a1738-0535-4940-adcf-c30c0017470a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:31.896320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:31.899441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:31.900314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:31.901928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] PATH_INFO: `/v3/users/de35c5c0a4f44cb699c77a009ea717cf` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:31.905991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de35c5c0a4f44cb699c77a009ea717cf)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:31.913268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:32.101505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:32.103008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.115946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a2b29-726b-4472-9898-5a3f8b559223 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:32.121342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:32.122238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.122537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.122828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] PATH_INFO: `/v3/users/2b537465493148e48cdc5e1ff4321819` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.125337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b537465493148e48cdc5e1ff4321819)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:32.127568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:32.196992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de35c5c0a4f44cb699c77a009ea717cf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.265782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de35c5c0a4f44cb699c77a009ea717cf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.273860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de35c5c0a4f44cb699c77a009ea717cf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.286867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de35c5c0a4f44cb699c77a009ea717cf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.289893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4213ddef-6183-4825-a658-f8bc72db04b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de35c5c0a4f44cb699c77a009ea717cf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.298075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1131/2236] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:31 2022] DELETE /identity/v3/users/de35c5c0a4f44cb699c77a009ea717cf => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:32.304308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.304690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.304980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.323769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:32.325248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.383907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b537465493148e48cdc5e1ff4321819'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.385129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b537465493148e48cdc5e1ff4321819'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.394020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1132/2237] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:32.395207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:32.397001 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.398389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b537465493148e48cdc5e1ff4321819'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.412988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b2b7c-d876-4bda-b92d-8c8409d99e1c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:32.418506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:32.419551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.419943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.420842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] PATH_INFO: `/v3/projects/b5da957d126f4ceca6e037e4b1d24fe6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.422281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5da957d126f4ceca6e037e4b1d24fe6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:32.424533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:32.426553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b537465493148e48cdc5e1ff4321819'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.427598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b537465493148e48cdc5e1ff4321819'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.517841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1106/2238] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:32 2022] DELETE /identity/v3/users/2b537465493148e48cdc5e1ff4321819 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:32.519448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:32.521171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.591036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5da957d126f4ceca6e037e4b1d24fe6', 'request_id': 'req-a3e81081-c734-4845-a735-51ff2743d369'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.601864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5da957d126f4ceca6e037e4b1d24fe6', 'request_id': 'req-a3e81081-c734-4845-a735-51ff2743d369'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.604857 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165ea5-2ce7-40f4-a723-bfa6da19091c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:32.662591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5da957d126f4ceca6e037e4b1d24fe6', 'request_id': 'req-a3e81081-c734-4845-a735-51ff2743d369'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.672741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:32.673854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.674232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.674522 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.677331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.677559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] The token cache is being invalidate because project b5da957d126f4ceca6e037e4b1d24fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:32.677864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.678583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a3e81081-c734-4845-a735-51ff2743d369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:32.680170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1133/2239] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:32 2022] DELETE /identity/v3/projects/b5da957d126f4ceca6e037e4b1d24fe6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:32.681539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.681975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.682294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.704177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:32.705959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.770217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:32.770217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:32.770874 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1107/2240] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:32.772034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:32.776316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.794896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d09bd3-9d63-4095-b313-f697b2f888db service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:32.801794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:32.802877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.803235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.803590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] PATH_INFO: `/v3/users/1df0ae054c8449bdb30bcdb6e9961e6d` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.805155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df0ae054c8449bdb30bcdb6e9961e6d)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:32.807461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1134/2241] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:32.807702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:32.823533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:32.826223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:32.844579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b87c5f-9f6c-4c6c-84a2-bb348bbdea3b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:32.848887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:32.849552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:32.849836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:32.850133 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:32.859998 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:32.861445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:32.872333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1135/2242] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:33.253571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df0ae054c8449bdb30bcdb6e9961e6d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.254610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df0ae054c8449bdb30bcdb6e9961e6d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.264322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df0ae054c8449bdb30bcdb6e9961e6d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.279252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df0ae054c8449bdb30bcdb6e9961e6d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.280214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df0ae054c8449bdb30bcdb6e9961e6d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.380720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1108/2243] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:32 2022] DELETE /identity/v3/users/1df0ae054c8449bdb30bcdb6e9961e6d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:33.410496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:33.412081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:33.473161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e21f4-14f1-4803-bf82-593570d5a7fa service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:33.582055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:33.582987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:33.583279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:33.583560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] PATH_INFO: `/v3/projects/56ff3980419443e19b7ec0f9827ea35f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:33.585000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ff3980419443e19b7ec0f9827ea35f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:33.587162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:33.647331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:33.648830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:33.664357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e42113-1844-4245-8a2f-fc482dad47e8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:33.675519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:33.676641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:33.676851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:33.677181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] PATH_INFO: `/v3/projects/cb1f1bc014d748398c72a1d1c6afe0c9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:33.679858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1f1bc014d748398c72a1d1c6afe0c9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:33.682243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:33.737544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ff3980419443e19b7ec0f9827ea35f', 'request_id': 'req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.743737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ff3980419443e19b7ec0f9827ea35f', 'request_id': 'req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.837021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ff3980419443e19b7ec0f9827ea35f', 'request_id': 'req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.851790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] The token cache is being invalidate because project 56ff3980419443e19b7ec0f9827ea35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:33.852145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.853009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1515eda9-e7fd-49db-bb9e-8dc3fe492ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.854666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1136/2244] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:33 2022] DELETE /identity/v3/projects/56ff3980419443e19b7ec0f9827ea35f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:33.859890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399c11-77f5-46a8-a94d-e83b563d5781 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:33.860465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399c11-77f5-46a8-a94d-e83b563d5781 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:33.861164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399c11-77f5-46a8-a94d-e83b563d5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:33.862563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1f1bc014d748398c72a1d1c6afe0c9', 'request_id': 'req-99bd2768-4c48-4f00-a38b-924914dee38c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.870900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1f1bc014d748398c72a1d1c6afe0c9', 'request_id': 'req-99bd2768-4c48-4f00-a38b-924914dee38c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.888689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d7399c11-77f5-46a8-a94d-e83b563d5781 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:33.894236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d7399c11-77f5-46a8-a94d-e83b563d5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:33.956561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1f1bc014d748398c72a1d1c6afe0c9', 'request_id': 'req-99bd2768-4c48-4f00-a38b-924914dee38c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.968431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1137/2245] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:33.968431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aee7a-d746-4bab-b77d-746616881532 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:33.968431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aee7a-d746-4bab-b77d-746616881532 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:33.968431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aee7a-d746-4bab-b77d-746616881532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:33.977499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] The token cache is being invalidate because project cb1f1bc014d748398c72a1d1c6afe0c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:33.977922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.978931 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:33.981529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1109/2246] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:33 2022] DELETE /identity/v3/projects/cb1f1bc014d748398c72a1d1c6afe0c9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:33.986829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:33.991205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-269aee7a-d746-4bab-b77d-746616881532 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:33.991205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-269aee7a-d746-4bab-b77d-746616881532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:33.991435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:34.003340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1138/2247] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:34.004757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aee7a-d746-4bab-b77d-746616881532 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:34.007400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd2768-4c48-4f00-a38b-924914dee38c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:34.013465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:34.015257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.015600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.015779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] PATH_INFO: `/v3/users/030ea2137339492cbe9bfb2a1a2ae234` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.017219 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=030ea2137339492cbe9bfb2a1a2ae234)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:34.019244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:34.021359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aee7a-d746-4bab-b77d-746616881532 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:34.028718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:34.030696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.031233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.031734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.032724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:34.033250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:34.037721 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:34.059918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1139/2248] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:34.071171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:34.085243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ddb48-eeed-4b17-85e3-9f6fb9041c21 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:34.091571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60616-a41a-4bbc-b049-d3ae393d8b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:34.092348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60616-a41a-4bbc-b049-d3ae393d8b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.092637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60616-a41a-4bbc-b049-d3ae393d8b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.092917 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60616-a41a-4bbc-b049-d3ae393d8b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.094230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60616-a41a-4bbc-b049-d3ae393d8b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:34.095946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60616-a41a-4bbc-b049-d3ae393d8b4a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:34.181952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1140/2249] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:34 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:34.183249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.183599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.183872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.220299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030ea2137339492cbe9bfb2a1a2ae234'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.221524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030ea2137339492cbe9bfb2a1a2ae234'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.223769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] MFA Rules not processed for user `af7e95f4699840629cda1680de65d77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:34.225058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:34.231831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030ea2137339492cbe9bfb2a1a2ae234'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.252768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030ea2137339492cbe9bfb2a1a2ae234'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.253883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030ea2137339492cbe9bfb2a1a2ae234'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.298651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1141/2250] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:34.306359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:34.306359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:34.353416 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1110/2251] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:33 2022] DELETE /identity/v3/users/030ea2137339492cbe9bfb2a1a2ae234 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:34.359349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:34.371400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:34.432480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e313a-9c91-456c-b172-5ddedcb2619a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:34.510939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520d1f1-2d36-4ac1-9f71-70f047fdde0d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:34.517819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:34.519964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.520309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.520590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] PATH_INFO: `/v3/users/2902257aadae42159632227998e645d3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.522066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2902257aadae42159632227998e645d3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:34.525502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:34.579199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:34.580150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.580537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.580947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.581833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:34.585919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:34.699934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1142/2252] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:34 2022] POST /identity/v3/users => generated 287 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:34.699934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:34.702378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:34.721566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347dd72-9c37-47f1-8338-e3dd391cc1d8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:34.731125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:34.732352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:34.732519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:34.732963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] PATH_INFO: `/v3/projects/6bac73f19ff1447a858267d0a06a7459` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:34.734294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bac73f19ff1447a858267d0a06a7459)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:34.736250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:34.797389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2902257aadae42159632227998e645d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.798595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2902257aadae42159632227998e645d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.809591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2902257aadae42159632227998e645d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.829854 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2902257aadae42159632227998e645d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.830864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2902257aadae42159632227998e645d3'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.878533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bac73f19ff1447a858267d0a06a7459', 'request_id': 'req-59e16277-0569-465f-96c9-1985b24290f8'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.885659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bac73f19ff1447a858267d0a06a7459', 'request_id': 'req-59e16277-0569-465f-96c9-1985b24290f8'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:34.980759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1111/2253] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:34 2022] DELETE /identity/v3/users/2902257aadae42159632227998e645d3 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:34.980759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:34.980991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.054937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bac73f19ff1447a858267d0a06a7459', 'request_id': 'req-59e16277-0569-465f-96c9-1985b24290f8'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.082683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] The token cache is being invalidate because project 6bac73f19ff1447a858267d0a06a7459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:35.083187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.085084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-59e16277-0569-465f-96c9-1985b24290f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.099460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1143/2254] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:34 2022] DELETE /identity/v3/projects/6bac73f19ff1447a858267d0a06a7459 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:35.108935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.109673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.112222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.119651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525e2af-885e-481b-92b6-1ac26dc3e197 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.130185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f14ecc-1ccb-454e-8097-8604ad1060ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.130892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f14ecc-1ccb-454e-8097-8604ad1060ee admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.131175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f14ecc-1ccb-454e-8097-8604ad1060ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.131450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f14ecc-1ccb-454e-8097-8604ad1060ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.132198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f14ecc-1ccb-454e-8097-8604ad1060ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.133915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f14ecc-1ccb-454e-8097-8604ad1060ee admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.144806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:35.146514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1112/2255] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:35.148095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.148383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.148667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.163037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.181756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:35.183307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.186495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1144/2256] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:35.189310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.191197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.206978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa3180-6a13-4d9a-a203-012b23e39dea None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.208251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1113/2257] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:35.209301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.211569 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.212411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bb41b-79ef-4805-9480-fcc0cac6c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.213194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb41b-79ef-4805-9480-fcc0cac6c300 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.213492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb41b-79ef-4805-9480-fcc0cac6c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.213769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb41b-79ef-4805-9480-fcc0cac6c300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.215007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb41b-79ef-4805-9480-fcc0cac6c300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.216795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bb41b-79ef-4805-9480-fcc0cac6c300 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.244112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1145/2258] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:35.244112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.244112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.244112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.274821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:35.277793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.289342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1146/2259] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:35.289342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.303002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac809b-defa-4bdc-808f-9ccc9fabeecb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.308211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.309412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.309412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.309662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] PATH_INFO: `/v3/projects/f1bdd75c266947aeb32f07253cc7dc7a/users/87a30e72ea6942928d199fb05be3d7cf/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.330100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bdd75c266947aeb32f07253cc7dc7a, user_id=87a30e72ea6942928d199fb05be3d7cf, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.334958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.351503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e22b6-d812-446a-b521-b721499d4dda None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.356196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.358151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.359429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.359842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.381104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.381104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.393100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1114/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:35.394340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.415463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604fc9c-cdcb-435f-8fda-103e5a53ac3a service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.422733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.423439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.423725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.424010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.424843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:35.425155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.426920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.443062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1115/2261] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:35.447493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.447493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.462763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cfe19-aa50-48d4-b076-870a18a8bb36 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.473692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1147/2262] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:35 2022] PUT /identity/v3/projects/f1bdd75c266947aeb32f07253cc7dc7a/users/87a30e72ea6942928d199fb05be3d7cf/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:35.475098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.490351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.492029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.492467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.492891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] PATH_INFO: `/v3/projects/51b347e988d641a1a935560ef4027644` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.495478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b347e988d641a1a935560ef4027644)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.499288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.590399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b1b4-5923-4d80-a0fc-95568e025d50 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.602452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d541-f685-4970-b7ff-edeb4117e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:35.603195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d541-f685-4970-b7ff-edeb4117e3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.603500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d541-f685-4970-b7ff-edeb4117e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.607373 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d541-f685-4970-b7ff-edeb4117e3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.609696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1d541-f685-4970-b7ff-edeb4117e3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:35.612424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1d541-f685-4970-b7ff-edeb4117e3f1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:35.660045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b347e988d641a1a935560ef4027644', 'request_id': 'req-14b427ee-ea6a-4376-a527-b493733ddcdc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.665604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b347e988d641a1a935560ef4027644', 'request_id': 'req-14b427ee-ea6a-4376-a527-b493733ddcdc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.770634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b347e988d641a1a935560ef4027644', 'request_id': 'req-14b427ee-ea6a-4376-a527-b493733ddcdc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.784114 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1148/2263] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:35.799658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641d8ca-ec9b-4678-aaee-9ca96e9cb0a8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.800409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641d8ca-ec9b-4678-aaee-9ca96e9cb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.801080 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641d8ca-ec9b-4678-aaee-9ca96e9cb0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.803692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] The token cache is being invalidate because project 51b347e988d641a1a935560ef4027644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:35.804204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.805327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:35.808962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1116/2264] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:35 2022] DELETE /identity/v3/projects/51b347e988d641a1a935560ef4027644 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:35.810501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:35.814656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.850715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3641d8ca-ec9b-4678-aaee-9ca96e9cb0a8 None None] MFA Rules not processed for user `87a30e72ea6942928d199fb05be3d7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:35.852029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3641d8ca-ec9b-4678-aaee-9ca96e9cb0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:35.913206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b427ee-ea6a-4376-a527-b493733ddcdc admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:35.927747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1149/2265] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:35.930196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:35.930196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:35.930572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:35.953788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:35.955439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.059319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.060189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.060546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.061325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.063540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.065934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.086151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1150/2266] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:36.086616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.098598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.179971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5d5a1-ebe2-4abc-beac-393ebb7c03c6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.183844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d27f9-5211-4e85-bdad-e3fcf9d91e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.184470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d27f9-5211-4e85-bdad-e3fcf9d91e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.184754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d27f9-5211-4e85-bdad-e3fcf9d91e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.185036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d27f9-5211-4e85-bdad-e3fcf9d91e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.195009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d27f9-5211-4e85-bdad-e3fcf9d91e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.196543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d27f9-5211-4e85-bdad-e3fcf9d91e62 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.201150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1117/2267] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:35 2022] POST /identity/v3/users => generated 289 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:36.202031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.203953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.208249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1151/2268] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:36.209430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.209730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.209994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.218534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e3a5-645b-4528-afcc-b899308a622d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.226072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.227859 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.228284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.228651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] PATH_INFO: `/v3/projects/8503db4bd6cb40e6a2fbaf2b08b00a25` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.230514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8503db4bd6cb40e6a2fbaf2b08b00a25)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.231993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:36.233550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.234025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.250779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1152/2269] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:36.250779 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.259050 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd617e1-0058-42f6-94c7-17db373b933c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.266302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.268038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.268539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.268956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.270150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.272764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.288059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1153/2270] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:36.289221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.302733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac590-7f6c-4e69-a528-b865f64ed9cb admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.309331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.310532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.311626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.312016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.312975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:36.313353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.315160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.337749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1154/2271] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:36.337749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.351989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00226e71-8cd5-4311-9e31-2f860f9ecdd9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.362004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.362980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.363447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.363872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.364869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.367628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.395635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1155/2272] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:36.395635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.413057 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5db7-0462-4538-b7f0-f778651eab5c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.421720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8503db4bd6cb40e6a2fbaf2b08b00a25', 'request_id': 'req-0499b44f-360f-441a-ba8b-2593187e2945'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:36.437303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8503db4bd6cb40e6a2fbaf2b08b00a25', 'request_id': 'req-0499b44f-360f-441a-ba8b-2593187e2945'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:36.521160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58732d8-18bb-49e3-8186-5bdf74895b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.521854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58732d8-18bb-49e3-8186-5bdf74895b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.522163 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58732d8-18bb-49e3-8186-5bdf74895b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.522438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58732d8-18bb-49e3-8186-5bdf74895b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.523165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58732d8-18bb-49e3-8186-5bdf74895b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.525181 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58732d8-18bb-49e3-8186-5bdf74895b56 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.577819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8503db4bd6cb40e6a2fbaf2b08b00a25', 'request_id': 'req-0499b44f-360f-441a-ba8b-2593187e2945'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:36.591464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] The token cache is being invalidate because project 8503db4bd6cb40e6a2fbaf2b08b00a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:36.591755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:36.593345 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:36.594706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1118/2273] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:36 2022] DELETE /identity/v3/projects/8503db4bd6cb40e6a2fbaf2b08b00a25 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:36.595496 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.596840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.611707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b44f-360f-441a-ba8b-2593187e2945 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.616671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333582ee-88e7-43da-b81b-2e9d46a324a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.621991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333582ee-88e7-43da-b81b-2e9d46a324a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.621991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333582ee-88e7-43da-b81b-2e9d46a324a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.621991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333582ee-88e7-43da-b81b-2e9d46a324a2 admin admin] PATH_INFO: `/v3/projects/eab345379a974ac299511b3a8a778ed1/users/48935e9067c1439abb098fb7b5521ae6/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.634855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333582ee-88e7-43da-b81b-2e9d46a324a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab345379a974ac299511b3a8a778ed1, user_id=48935e9067c1439abb098fb7b5521ae6, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.637540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333582ee-88e7-43da-b81b-2e9d46a324a2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.647645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1156/2274] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:36.649083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.649380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.649659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.668431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:36.669742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.736411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1157/2275] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:36.737383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.738752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.751949 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1119/2276] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:36 2022] PUT /identity/v3/projects/eab345379a974ac299511b3a8a778ed1/users/48935e9067c1439abb098fb7b5521ae6/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:36.752160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3014-5149-4b78-a97c-33fc5d04da6b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.753622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940e89c-c416-4eae-b67d-dbba03d6e157 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.753918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940e89c-c416-4eae-b67d-dbba03d6e157 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.754226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940e89c-c416-4eae-b67d-dbba03d6e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.777672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-3940e89c-c416-4eae-b67d-dbba03d6e157 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:36.777672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3940e89c-c416-4eae-b67d-dbba03d6e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.826206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.827841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.828244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.828548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.830301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.836055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.859607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1120/2277] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:36.861091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.861435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.861695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.892031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] MFA Rules not processed for user `48935e9067c1439abb098fb7b5521ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:36.893285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:36.943636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1158/2278] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:36.943636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.952621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5348-b4b5-48b2-922b-da2b008fdb17 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.958770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.959446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.959729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.960000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.960728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:36.961358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.962854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:36.969091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1121/2279] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:36.973756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.977030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1159/2280] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:36.978359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:36.983004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a44e8-f3ee-4b69-ae67-2861a895ac37 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.990750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:36.991820 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:36.992204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:36.992577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:36.993317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58188686-ac64-4384-a2ee-8b618277b58a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:36.993642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:36.995425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.000371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.001637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.001637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.001931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.002555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.004515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.008380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1122/2281] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:37.009316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.022620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74283ee4-b2d2-46b9-bbae-d5e03298f496 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.027514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.032693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.032693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.032693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.032693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.032693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.098890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1160/2282] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:36 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:37.101153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.134593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1123/2283] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:37 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:37.136276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.214732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc69a2a-dcde-4a65-906c-95abf9eeeeb8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.288481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72baac2-99ef-4160-ba3e-37f8c600fe4b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.294753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.295929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.296536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.297121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.298066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.300501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.302843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.304560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.305121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.308366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.308366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.312201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.333873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1161/2284] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:37.335547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.354806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31795809-714e-40ae-8c94-ecccdedb0f29 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.362824 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.363944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.364430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.364916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.366184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.370334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.403844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1124/2285] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:37 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:37.405636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.419033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742ae90-c64a-4dc5-95fc-7484cede7fdd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.428252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.429998 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.430561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.431080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] PATH_INFO: `/v3/projects/e85d5221c6174f65a079372387d49c86/users/3df4c469af91424ab87ca8b77051812a/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.449467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1162/2286] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:37 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:37.452559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.452765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85d5221c6174f65a079372387d49c86, user_id=3df4c469af91424ab87ca8b77051812a, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.456327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.461718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cf5b2-e7d3-4844-b060-8c089cd06933 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.481539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.481539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.481539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.481539 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.483156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.485317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.511450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1163/2287] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:37.512698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.528560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d86e99-b998-44dd-9b03-1344266f1952 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.534596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.535290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.535570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.538504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.538504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.538504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.549732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1164/2288] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:37.550412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.563348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b736b-958c-4e22-a0c7-e31ccff981da admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.567284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1125/2289] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:37 2022] PUT /identity/v3/projects/e85d5221c6174f65a079372387d49c86/users/3df4c469af91424ab87ca8b77051812a/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:37.567284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.655636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742f7af-527c-4f9d-b542-804acc9cea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.656374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742f7af-527c-4f9d-b542-804acc9cea56 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.656692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742f7af-527c-4f9d-b542-804acc9cea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.656939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742f7af-527c-4f9d-b542-804acc9cea56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.657709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742f7af-527c-4f9d-b542-804acc9cea56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.659777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742f7af-527c-4f9d-b542-804acc9cea56 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.675960 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f411-279b-4d75-8480-d938f3dc1bfe admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.687650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1165/2290] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:37.688740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.689626 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.689780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.690145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.690594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.690910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.691363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.691897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.694671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.709600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1126/2291] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:37.710634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.725764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46142-b537-4cd2-95f7-17c3636b9003 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.730426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] MFA Rules not processed for user `3df4c469af91424ab87ca8b77051812a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:37.731699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.731890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:37.732917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.733392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.733681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] PATH_INFO: `/v3/projects/6483c1a1ab2949bc87aa7cf219b7f7a0/users/da69a3d68c314a04a939490e2d3051ed/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.751920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6483c1a1ab2949bc87aa7cf219b7f7a0, user_id=da69a3d68c314a04a939490e2d3051ed, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.754821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.813417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1166/2292] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:37.814530 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.827913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371179b9-1c85-4198-af16-83600060b5e4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.841409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e2bf1-88ee-4b7e-b44c-67adf058cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.843290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2bf1-88ee-4b7e-b44c-67adf058cfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.843775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2bf1-88ee-4b7e-b44c-67adf058cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.844167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2bf1-88ee-4b7e-b44c-67adf058cfc9 admin admin] PATH_INFO: `/v3/projects/e9affa1858784c7c97bbbbe63c4e1d9f/users/cc2e37880aa74322b2bb19cf1ae4721c/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.865497 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e2bf1-88ee-4b7e-b44c-67adf058cfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9affa1858784c7c97bbbbe63c4e1d9f, user_id=cc2e37880aa74322b2bb19cf1ae4721c, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:37.868383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1127/2293] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:37 2022] PUT /identity/v3/projects/6483c1a1ab2949bc87aa7cf219b7f7a0/users/da69a3d68c314a04a939490e2d3051ed/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:37.869785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:37.878291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:37.878663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e2bf1-88ee-4b7e-b44c-67adf058cfc9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:37.946639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f3d58-e5a7-4689-8146-7ccc3ddeb116 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:37.951267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb47915-bcea-41f8-8273-4e5f23d7ae74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:37.952637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb47915-bcea-41f8-8273-4e5f23d7ae74 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.952930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb47915-bcea-41f8-8273-4e5f23d7ae74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.953337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb47915-bcea-41f8-8273-4e5f23d7ae74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:37.967556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1167/2294] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:37 2022] PUT /identity/v3/projects/e9affa1858784c7c97bbbbe63c4e1d9f/users/cc2e37880aa74322b2bb19cf1ae4721c/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:37.970232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a2a5-65c9-49d4-8282-cbb423334610 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:37.970778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a2a5-65c9-49d4-8282-cbb423334610 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:37.971302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a2a5-65c9-49d4-8282-cbb423334610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.024702 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8ac2a2a5-65c9-49d4-8282-cbb423334610 None None] MFA Rules not processed for user `da69a3d68c314a04a939490e2d3051ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:38.026281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb47915-bcea-41f8-8273-4e5f23d7ae74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:38.027032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8ac2a2a5-65c9-49d4-8282-cbb423334610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.027764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb47915-bcea-41f8-8273-4e5f23d7ae74 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:38.038196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1128/2295] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:38.039602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.039995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.040184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.079483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:38.080630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.122720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1168/2296] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:38.124835 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.125195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.125435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.153452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] MFA Rules not processed for user `cc2e37880aa74322b2bb19cf1ae4721c`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:38.155780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.165548 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1129/2297] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:38.166450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:38.262526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1169/2298] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:38.262526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:38.288202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2fce5-ce01-4802-9561-49014b8ac85f None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:38.297240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:38.299086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.299619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.300159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] PATH_INFO: `/v3/users/3df4c469af91424ab87ca8b77051812a` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.302398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df4c469af91424ab87ca8b77051812a)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:38.306532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:38.355143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8f13-0104-4ab0-a181-ab100ccc3ba5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:38.363720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:38.363720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.363720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.363720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.364152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:38.364703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:38.499479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1170/2299] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:38 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:38.499479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:38.500301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.531575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df4c469af91424ab87ca8b77051812a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:38.532981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df4c469af91424ab87ca8b77051812a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:38.544826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df4c469af91424ab87ca8b77051812a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:38.571782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df4c469af91424ab87ca8b77051812a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:38.572969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df4c469af91424ab87ca8b77051812a'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:38.624614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6454bb0-e2c0-45ed-873f-aa5fb3d53e07 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:38.629671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:38.630386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.630667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.630939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.632771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.665891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1130/2300] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:38 2022] DELETE /identity/v3/users/3df4c469af91424ab87ca8b77051812a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:38.666967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:38.668298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.696256 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:38.698014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:38.708144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1171/2301] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:20:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:20:38.708817 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:38.712262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.749430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec34d0-f1ee-44b3-a399-336bc634a163 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:38.753575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:38.754567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.754567 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.758549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.758549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.827626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc3fa-2e4b-4b18-b090-2c25275313e0 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:38.865018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:38.868692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa742362-674b-4c79-b6b7-653fa4a41be9 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:38.889212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1131/2302] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:38.890832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.892075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.892075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.930749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:38.933842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:38.943248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:38.944130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:38.944483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:38.944987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:38.945783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:38.947987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.008440 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1132/2303] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:39.020728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.022137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.056648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1172/2304] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:38 2022] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:39.060583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.073463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7ac0-2a2c-469a-a894-bb4d6e02442c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.079572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.080261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.080547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.080879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.081680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.083744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.098254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1173/2305] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:39.105989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.110144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7613786-62a2-4b79-aa77-6e47c6c1660c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.114620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.115488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.115997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.117385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.123649 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44170-63a4-4191-94b4-d1de126c1afa admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.133568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.136294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.136745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.137127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.137765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] PATH_INFO: `/v3/projects/8464f13c82a848e2b336a389be1c2f19/users/64b13c5f914c4af5b222192c2f95e96f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.139692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.152081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1133/2306] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:39.158683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8464f13c82a848e2b336a389be1c2f19, user_id=64b13c5f914c4af5b222192c2f95e96f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.161396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.233400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1174/2307] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:39 2022] PUT /identity/v3/projects/8464f13c82a848e2b336a389be1c2f19/users/64b13c5f914c4af5b222192c2f95e96f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:39.239507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.259412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b5467-27ba-437a-b38d-2f5896768be2 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.354815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727085-1f04-4dd2-bc09-4923241fbc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.355492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727085-1f04-4dd2-bc09-4923241fbc54 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.355772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727085-1f04-4dd2-bc09-4923241fbc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.356048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727085-1f04-4dd2-bc09-4923241fbc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.356791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727085-1f04-4dd2-bc09-4923241fbc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.359323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727085-1f04-4dd2-bc09-4923241fbc54 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.373901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1134/2308] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:39.375218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.387833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e72f26-6450-4aaf-b6b1-f4a42d82dcdd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.392218 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.393606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.393894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.394196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] PATH_INFO: `/v3/projects/8464f13c82a848e2b336a389be1c2f19/users/64b13c5f914c4af5b222192c2f95e96f/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.399635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8464f13c82a848e2b336a389be1c2f19, user_id=64b13c5f914c4af5b222192c2f95e96f, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.402325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.418165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1175/2309] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:39 2022] PUT /identity/v3/projects/8464f13c82a848e2b336a389be1c2f19/users/64b13c5f914c4af5b222192c2f95e96f/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:39.428331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.428757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.429201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.469793 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] MFA Rules not processed for user `64b13c5f914c4af5b222192c2f95e96f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:39.471495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.553903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1135/2310] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:39.637023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.639009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.710466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d801821-0074-40fc-b0fd-9a337c37ab9c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.714606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.715524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.716378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.716378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.718413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.745823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.747631 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.833762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.835238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e6f0-dda9-4cd5-b61d-2d7767594904 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.846738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf84c1-2472-4ea7-80b3-90ffc0689ff4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:39.852405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1176/2311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:39.852405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.852405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.852405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.852778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:39.852983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:39.853234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:39.853410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] PATH_INFO: `/v3/projects/e85d5221c6174f65a079372387d49c86` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:39.854675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85d5221c6174f65a079372387d49c86)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:39.857300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:39.870646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:39.871956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.933887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1177/2312] 10.222.0.49 () {58 vars in 967 bytes} [Mon Apr 11 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:39.952519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:39.954276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:39.973101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85d5221c6174f65a079372387d49c86', 'request_id': 'req-a37712f8-556f-42e8-91e1-e5f1bba66774'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:39.984906 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85d5221c6174f65a079372387d49c86', 'request_id': 'req-a37712f8-556f-42e8-91e1-e5f1bba66774'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:40.044632 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbda2de-7d3c-4063-87d1-e0b762ac95fd None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.077144 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85d5221c6174f65a079372387d49c86', 'request_id': 'req-a37712f8-556f-42e8-91e1-e5f1bba66774'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:40.090075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] The token cache is being invalidate because project e85d5221c6174f65a079372387d49c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:40.090377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:40.091060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a37712f8-556f-42e8-91e1-e5f1bba66774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:40.092829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1136/2313] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:39 2022] DELETE /identity/v3/projects/e85d5221c6174f65a079372387d49c86 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:40.098954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.099250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.099743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.110344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.111004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.111290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.111569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.113431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:40.118463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:40.119650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:40.178306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.179941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0180-d484-4a2c-8601-0132c9615b68 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.195345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1178/2314] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:20:40.205462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1137/2315] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:40.217190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.217640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.218085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.246932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:40.246932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:40.255481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1179/2316] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:40.260520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:40.272102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6625-02f9-4d5f-a644-3091ca20974c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.279279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.280009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.280292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.280807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.281579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:40.281915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.283704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.306197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1138/2317] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:40.308562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:40.324562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44cdaa-03a6-4f1f-83c3-9cad1f157465 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.338781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.339510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.339798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.340079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.341162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.343465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.442031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1180/2318] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:40 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:40.446299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:40.457281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d2eb-a37e-453b-a024-7a2d3741d48a admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.550561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.556175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.556175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.556175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.556175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.556175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.658678 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1139/2319] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:40 2022] POST /identity/v3/users => generated 280 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:40.660041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:40.675621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa92f8-6de2-4bdd-bc92-337c1c2d0067 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.680672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.681344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.681633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.681909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.682969 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.684415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.695927 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1181/2320] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:40.705049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:40.711782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0fe34-2931-4972-a051-97f77eaaa74e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.716665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669d186-fb58-4c70-9e00-016634a4ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.717370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669d186-fb58-4c70-9e00-016634a4ae7c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.717652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669d186-fb58-4c70-9e00-016634a4ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.717928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669d186-fb58-4c70-9e00-016634a4ae7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.718693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669d186-fb58-4c70-9e00-016634a4ae7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.720442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669d186-fb58-4c70-9e00-016634a4ae7c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.746190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1140/2321] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:40.750322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:40.768907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6bbc6-2b8d-4777-9eba-f29da8f8095c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:40.775257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c10a26-5f91-4971-9943-150175203ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:40.776599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10a26-5f91-4971-9943-150175203ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.777036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10a26-5f91-4971-9943-150175203ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.777429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10a26-5f91-4971-9943-150175203ed5 admin admin] PATH_INFO: `/v3/projects/5ffe8a50180b43d29ad1dd2d980a6fa3/users/ece5ff9496dd41dc8adf95403d3cfabc/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.797638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10a26-5f91-4971-9943-150175203ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffe8a50180b43d29ad1dd2d980a6fa3, user_id=ece5ff9496dd41dc8adf95403d3cfabc, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:40.800656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10a26-5f91-4971-9943-150175203ed5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:40.917980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1182/2322] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:40 2022] PUT /identity/v3/projects/5ffe8a50180b43d29ad1dd2d980a6fa3/users/ece5ff9496dd41dc8adf95403d3cfabc/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:40.929760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:40.929971 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:40.930285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:40.959306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] MFA Rules not processed for user `ece5ff9496dd41dc8adf95403d3cfabc`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:40.960656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:41.032581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.032893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.033145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:41.057886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:41.058791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1141/2323] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:41.059235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:41.096086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:41.097494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:41.127171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1183/2324] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:41.140977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:41.142460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:41.182199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700df3-2552-4144-a9bc-90f5c514f218 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:41.186431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:41.187080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.187353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.187628 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:41.196903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:41.198412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:41.209677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1142/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:41.213254 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda4aca-2e8b-4f4b-a515-ef55e4bfa3af None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:41.227260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:41.227630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a63c5-5e7a-4b10-88fd-923c7c660d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:41.228294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a63c5-5e7a-4b10-88fd-923c7c660d8c service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.228574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a63c5-5e7a-4b10-88fd-923c7c660d8c service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.228847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a63c5-5e7a-4b10-88fd-923c7c660d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:41.239491 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a63c5-5e7a-4b10-88fd-923c7c660d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:41.241172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a63c5-5e7a-4b10-88fd-923c7c660d8c service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:41.255604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1184/2326] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:20:41.309430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2c43-6ff6-4c7e-bf91-1ece9affb654 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:41.314306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:41.315234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.315511 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.315861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] PATH_INFO: `/v3/users/ece5ff9496dd41dc8adf95403d3cfabc` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:41.317055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece5ff9496dd41dc8adf95403d3cfabc)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:41.319024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:41.553406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece5ff9496dd41dc8adf95403d3cfabc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:41.554209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece5ff9496dd41dc8adf95403d3cfabc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:41.563575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece5ff9496dd41dc8adf95403d3cfabc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:41.579633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece5ff9496dd41dc8adf95403d3cfabc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:41.580369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece5ff9496dd41dc8adf95403d3cfabc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:41.669757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1143/2327] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:41 2022] DELETE /identity/v3/users/ece5ff9496dd41dc8adf95403d3cfabc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:41.675958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac724-7fd1-4ef5-af7f-210d6ac5df98 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.676526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac724-7fd1-4ef5-af7f-210d6ac5df98 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.676526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac724-7fd1-4ef5-af7f-210d6ac5df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:41.695076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3b8ac724-7fd1-4ef5-af7f-210d6ac5df98 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:41.696172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3b8ac724-7fd1-4ef5-af7f-210d6ac5df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:41.769193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1185/2328] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:41.778982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:41.781263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:41.845948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a72b-b300-49ed-9306-8d5d7735af36 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:41.849583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:41.850316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.850600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.850875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:41.861432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:41.863102 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:41.878291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1144/2329] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:41.991840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:41.991840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:41.991840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:42.010076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:42.010076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:42.054621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:42.055728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:42.123703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1186/2330] 10.222.0.49 () {58 vars in 967 bytes} [Mon Apr 11 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:42.124638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464be84-88ae-46cb-803d-9ce941a91f3d service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:42.134503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:42.134503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:42.134503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:42.134503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:42.134816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:42.151261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:42.155293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:42.208879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:42.212206 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:42.254639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1145/2331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:42.288174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f0d4-a8d0-4c3a-9a77-55d03e4c6867 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:42.294553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b54b-6738-460f-8ca7-bd363f495d1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:42.296101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b54b-6738-460f-8ca7-bd363f495d1d service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:42.297412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b54b-6738-460f-8ca7-bd363f495d1d service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:42.297892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b54b-6738-460f-8ca7-bd363f495d1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:42.308534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b54b-6738-460f-8ca7-bd363f495d1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:42.310502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b54b-6738-460f-8ca7-bd363f495d1d service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:42.321685 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1187/2332] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:20:42.575558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:42.579957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:42.603958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b764-55b2-4ef1-a96b-0c5cbb84f41e service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:42.603958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:42.604544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:42.604638 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:42.604907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] PATH_INFO: `/v3/projects/5ffe8a50180b43d29ad1dd2d980a6fa3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:42.606138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffe8a50180b43d29ad1dd2d980a6fa3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:42.608939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:42.746692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffe8a50180b43d29ad1dd2d980a6fa3', 'request_id': 'req-ff0d4594-4d25-4303-89a1-9ec19185b7cb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:42.754350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffe8a50180b43d29ad1dd2d980a6fa3', 'request_id': 'req-ff0d4594-4d25-4303-89a1-9ec19185b7cb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:42.847935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffe8a50180b43d29ad1dd2d980a6fa3', 'request_id': 'req-ff0d4594-4d25-4303-89a1-9ec19185b7cb'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:42.861866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] The token cache is being invalidate because project 5ffe8a50180b43d29ad1dd2d980a6fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:42.862183 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:42.862844 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ff0d4594-4d25-4303-89a1-9ec19185b7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:42.864672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1146/2333] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:42 2022] DELETE /identity/v3/projects/5ffe8a50180b43d29ad1dd2d980a6fa3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:42.869742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:42.870255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:42.870664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:42.892293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:42.893516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:42.974358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1188/2334] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:42.987176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:42.987603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:42.988007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.008169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:43.009424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:43.018229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1147/2335] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:43.023662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.034953 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b688-5ea0-4253-9f42-1059639f607b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:43.040431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:43.041119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.041448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.041726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.042598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:43.042951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:43.045748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:43.060286 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1189/2336] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:43.065595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.075699 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a879-7041-4843-a0a8-d23b313174a0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:43.081277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:43.081950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.082278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.082543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.083245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:43.085164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:43.189825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1148/2337] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:43 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:43.194222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.219134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068885-c37d-4850-905b-a8af9da29e9e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:43.280806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:43.281540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.281827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.282141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.282976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:43.284935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:43.401696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.404509 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1190/2338] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:43 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:43.425452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49f09-cfe1-479e-ae19-9f1f94f047e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:43.434935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:43.436185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.436703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.437016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.437864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:43.439577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:43.465015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.471609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1149/2339] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:43.494683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459ddf5-7afd-4504-ba2b-0e7dfc0dc8a1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:43.506065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3483f-7aa7-4773-940b-e0b83f3f3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:43.506065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3483f-7aa7-4773-940b-e0b83f3f3925 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.506701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3483f-7aa7-4773-940b-e0b83f3f3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.507204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3483f-7aa7-4773-940b-e0b83f3f3925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.508321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3483f-7aa7-4773-940b-e0b83f3f3925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:43.509875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3483f-7aa7-4773-940b-e0b83f3f3925 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:43.526187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1191/2340] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:43.530970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.542899 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64106ff7-49b0-492f-9d96-91cbabcd454f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:43.553068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:43.554292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.554766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.555265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] PATH_INFO: `/v3/projects/68c2d525765b4848abd992e3c3c5ab54/users/cc0787e110b04b4c821a7b33be5b6ac5/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.572294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c2d525765b4848abd992e3c3c5ab54, user_id=cc0787e110b04b4c821a7b33be5b6ac5, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:43.574991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:43.654746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1150/2341] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:43 2022] PUT /identity/v3/projects/68c2d525765b4848abd992e3c3c5ab54/users/cc0787e110b04b4c821a7b33be5b6ac5/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:43.671308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:43.671630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:43.671869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:43.719220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] MFA Rules not processed for user `cc0787e110b04b4c821a7b33be5b6ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:43.721897 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:43.839730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1192/2342] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:20:43.944690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:43.946482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:44.010591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d036f8-792c-4e33-b59c-2c902fa29d4f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:44.014891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:44.015549 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:44.015829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:44.016107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:44.024936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:44.026716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:44.039018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1151/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:44.702748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:44.720805 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6a4f4-79f7-42c2-98d3-f7197752d439 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:44.726279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:44.727108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:44.727546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:44.728008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:44.734040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:44.868213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:44.870214 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defa938-7063-4797-a4ce-0cc29d133083 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:44.899045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1193/2344] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:50.240464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:50.243493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:50.325507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2016b5-19fe-4d4e-a48b-0287441f8c0a service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:50.331231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:50.332209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:50.332489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:50.332760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] PATH_INFO: `/v3/users/a850280698764ec0912d836d045a3e82` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:50.334321 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a850280698764ec0912d836d045a3e82)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:50.336410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:50.614353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a850280698764ec0912d836d045a3e82'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:50.615263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a850280698764ec0912d836d045a3e82'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:50.624232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a850280698764ec0912d836d045a3e82'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:50.647928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a850280698764ec0912d836d045a3e82'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:50.648904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a850280698764ec0912d836d045a3e82'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:50.808378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1152/2345] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:50 2022] DELETE /identity/v3/users/a850280698764ec0912d836d045a3e82 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:50.813636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:50.814249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:50.814249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:50.834093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:50.834093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:50.929405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1194/2346] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:50.951958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:50.964614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:51.038220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b469cc1-2b21-49a8-9f8a-c434a2c160c0 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:51.042636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c30b46-8936-4240-9a7e-1263c0b534af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:51.043438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30b46-8936-4240-9a7e-1263c0b534af service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:51.043994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30b46-8936-4240-9a7e-1263c0b534af service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:51.044281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30b46-8936-4240-9a7e-1263c0b534af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:51.056348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c30b46-8936-4240-9a7e-1263c0b534af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:51.058250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c30b46-8936-4240-9a7e-1263c0b534af service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:51.069849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1153/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:51.461121 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:51.463207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:51.477808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb0f4b-a4c6-4a74-a45d-012314ff1d51 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:51.487486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:51.488398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:51.488680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:51.488952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] PATH_INFO: `/v3/projects/727467f6f2c24376b3b198ae11ca1b1e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:51.490742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727467f6f2c24376b3b198ae11ca1b1e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:51.493412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:51.617028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727467f6f2c24376b3b198ae11ca1b1e', 'request_id': 'req-7a362eda-185b-45a0-b7a2-5665e053ada3'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:51.622391 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727467f6f2c24376b3b198ae11ca1b1e', 'request_id': 'req-7a362eda-185b-45a0-b7a2-5665e053ada3'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:51.682622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727467f6f2c24376b3b198ae11ca1b1e', 'request_id': 'req-7a362eda-185b-45a0-b7a2-5665e053ada3'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:51.696298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] The token cache is being invalidate because project 727467f6f2c24376b3b198ae11ca1b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:51.696775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:51.697523 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7a362eda-185b-45a0-b7a2-5665e053ada3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:51.699361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1195/2348] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:51 2022] DELETE /identity/v3/projects/727467f6f2c24376b3b198ae11ca1b1e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:51.705355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:51.705867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:51.705992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:51.725900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:51.727249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:51.826122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1154/2349] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:51.835672 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:51.836293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:51.836553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:51.858145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:51.859582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:51.869221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1196/2350] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:51.874322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:51.884067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c047c-2dc7-4743-9db8-5faac27c8e27 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:51.888758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:51.889441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:51.889713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:51.889988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:51.890763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:51.891070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:51.892684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:51.904682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1155/2351] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:20:51.909416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:51.919040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bdde-c2a5-4e11-87a0-1430eeeb49b3 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:51.924524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:51.925186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:51.925486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:51.925746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:51.926501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:51.928411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:52.041240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1197/2352] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:51 2022] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:52.045979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:52.057273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6a22-0478-4f1e-8da7-0c914d773648 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:52.138447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:52.139133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:52.139419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:52.139696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:52.140408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:52.142438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:52.238803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1156/2353] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:52 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:20:52.243339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:52.256416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9ab8-31a7-4b65-9dcd-de373b4b571e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:52.263290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:52.265154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:52.265664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:52.266025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:52.267161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:52.269015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:52.282955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1198/2354] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:52.287283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:52.299693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140c6d2-56c9-43d8-b0fb-7d61782f8352 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:52.304779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7bb5a-da22-4701-a24d-cf8f2a79e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:52.305495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7bb5a-da22-4701-a24d-cf8f2a79e976 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:52.305789 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7bb5a-da22-4701-a24d-cf8f2a79e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:52.306084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7bb5a-da22-4701-a24d-cf8f2a79e976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:52.306907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7bb5a-da22-4701-a24d-cf8f2a79e976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:52.308643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7bb5a-da22-4701-a24d-cf8f2a79e976 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:52.320501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1157/2355] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:52.325775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:52.336732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7bf2-e460-4771-93ac-992b70f00c3c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:52.341686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:52.343227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:52.343600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:52.343992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] PATH_INFO: `/v3/projects/324e97f44b034272b80f37f3f72f037b/users/38bde804434f4994b80a0a286bedd6d5/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:52.362610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] RBAC: Authorizing `identity:create_grant(project_id=324e97f44b034272b80f37f3f72f037b, user_id=38bde804434f4994b80a0a286bedd6d5, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:52.365450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:52.456458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1199/2356] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:52 2022] PUT /identity/v3/projects/324e97f44b034272b80f37f3f72f037b/users/38bde804434f4994b80a0a286bedd6d5/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:52.468091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:52.468776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:52.469382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:52.509257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] MFA Rules not processed for user `38bde804434f4994b80a0a286bedd6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:52.510565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:52.587994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1158/2357] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:52.600397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:52.602138 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:52.664303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138146-efb7-43b3-bbdd-a79bfc57689e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:52.668049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2faec-0f24-4813-9ab8-a3a3dc1e748a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:52.669019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2faec-0f24-4813-9ab8-a3a3dc1e748a service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:52.669019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2faec-0f24-4813-9ab8-a3a3dc1e748a service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:52.669379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2faec-0f24-4813-9ab8-a3a3dc1e748a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:52.678860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2faec-0f24-4813-9ab8-a3a3dc1e748a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:52.680311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2faec-0f24-4813-9ab8-a3a3dc1e748a service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:52.690759 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1200/2358] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:54.680830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:54.682978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:54.776278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033c8e-b188-409c-b3ac-8a6e53f3a617 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:54.782195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:54.783088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:54.783454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:54.783819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] PATH_INFO: `/v3/users/87a30e72ea6942928d199fb05be3d7cf` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:54.785013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a30e72ea6942928d199fb05be3d7cf)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:54.786962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:55.057400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a30e72ea6942928d199fb05be3d7cf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.058058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a30e72ea6942928d199fb05be3d7cf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.066672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a30e72ea6942928d199fb05be3d7cf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.082272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a30e72ea6942928d199fb05be3d7cf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.083030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a30e72ea6942928d199fb05be3d7cf'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.183160 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1159/2359] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:54 2022] DELETE /identity/v3/users/87a30e72ea6942928d199fb05be3d7cf => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:55.188378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:55.188956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:55.188956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:55.206334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:55.207472 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:55.300334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1201/2360] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:55.311972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:55.313776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:55.427247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:55.429715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:55.465289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f2f49-8029-4377-9c76-e5fd6c3ddc5f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:55.476904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:55.478223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4b84-b8e2-4cc2-9033-520cf38ce867 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:55.479644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:55.480098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:55.481657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] PATH_INFO: `/v3/users/48935e9067c1439abb098fb7b5521ae6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:55.484290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48935e9067c1439abb098fb7b5521ae6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:55.491220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82d091-f6c3-4e89-aa08-e7cf11045f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:55.491220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82d091-f6c3-4e89-aa08-e7cf11045f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:55.491220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82d091-f6c3-4e89-aa08-e7cf11045f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:55.494126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82d091-f6c3-4e89-aa08-e7cf11045f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:55.494231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:55.505519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82d091-f6c3-4e89-aa08-e7cf11045f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:55.507027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82d091-f6c3-4e89-aa08-e7cf11045f30 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:55.528478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1160/2361] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:55.787771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48935e9067c1439abb098fb7b5521ae6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.871451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48935e9067c1439abb098fb7b5521ae6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.879921 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48935e9067c1439abb098fb7b5521ae6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.894585 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48935e9067c1439abb098fb7b5521ae6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.895346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48935e9067c1439abb098fb7b5521ae6'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:55.902772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1202/2362] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:55 2022] DELETE /identity/v3/users/48935e9067c1439abb098fb7b5521ae6 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:55.911518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:55.912223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:55.912223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:55.944667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:55.945888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:56.022411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1161/2363] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:56.040746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.043430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:56.113356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311a070-975d-4500-b5aa-289285b86459 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:56.117406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd63da-fdd4-4fa6-ad27-09a618820240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:56.118262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd63da-fdd4-4fa6-ad27-09a618820240 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.118608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd63da-fdd4-4fa6-ad27-09a618820240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.118889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd63da-fdd4-4fa6-ad27-09a618820240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.133683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd63da-fdd4-4fa6-ad27-09a618820240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:56.135168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd63da-fdd4-4fa6-ad27-09a618820240 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:56.146389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1203/2364] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:20:56.183887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.185352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:56.197977 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5cac5-470f-4c77-9a6b-3ddad93724a0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:56.203782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:56.204660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.204934 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.205202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] PATH_INFO: `/v3/projects/f1bdd75c266947aeb32f07253cc7dc7a` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.210810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bdd75c266947aeb32f07253cc7dc7a)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:56.210810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:56.397376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bdd75c266947aeb32f07253cc7dc7a', 'request_id': 'req-b912d235-22eb-4dc0-95f3-ab4f40911245'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.402873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bdd75c266947aeb32f07253cc7dc7a', 'request_id': 'req-b912d235-22eb-4dc0-95f3-ab4f40911245'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.515182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bdd75c266947aeb32f07253cc7dc7a', 'request_id': 'req-b912d235-22eb-4dc0-95f3-ab4f40911245'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.531864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] The token cache is being invalidate because project f1bdd75c266947aeb32f07253cc7dc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:56.535562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.535562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b912d235-22eb-4dc0-95f3-ab4f40911245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.537453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1162/2365] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:56 2022] DELETE /identity/v3/projects/f1bdd75c266947aeb32f07253cc7dc7a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:56.542170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.542667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.542804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.571169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:56.572402 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:56.648494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1204/2366] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:56.659900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.660225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.660520 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.679784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:56.680984 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:56.689437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1163/2367] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:56.693984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.704360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf5e56-c97a-4018-8bff-b07ae7e78829 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:56.711614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.713040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:56.717467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:56.718433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.718723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.719010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.719780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:20:56.720098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:56.721740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:56.727615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f58ac-200a-4744-aefb-5531c75443c1 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:56.733340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:56.734258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.734543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.734816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] PATH_INFO: `/v3/projects/eab345379a974ac299511b3a8a778ed1` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.738903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab345379a974ac299511b3a8a778ed1)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:56.742506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:56.749573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1205/2368] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:20:56.760516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.772709 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34000d58-a06b-470f-8990-1d8f7ac25837 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:56.778399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:56.779085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.780309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.780309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.780881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:56.782996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:56.877171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab345379a974ac299511b3a8a778ed1', 'request_id': 'req-ecddf427-d9f0-4202-8a8c-003ea439aa26'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.883599 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab345379a974ac299511b3a8a778ed1', 'request_id': 'req-ecddf427-d9f0-4202-8a8c-003ea439aa26'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.886627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1206/2369] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:20:56 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:56.891601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.956474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d747416-0544-430b-af6c-4095f304a24a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:56.961741 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:56.962500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:56.962804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:56.963073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:56.963961 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:56.966001 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:56.971784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab345379a974ac299511b3a8a778ed1', 'request_id': 'req-ecddf427-d9f0-4202-8a8c-003ea439aa26'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.986574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] The token cache is being invalidate because project eab345379a974ac299511b3a8a778ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:56.987017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.987868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:56.989630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1164/2370] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:56 2022] DELETE /identity/v3/projects/eab345379a974ac299511b3a8a778ed1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:56.993594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:56.995024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:57.043904 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1207/2371] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:20:56 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:20:57.045132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:57.048113 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:57.063093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b51ce9-ec61-46cd-b81b-7fc9d76243e6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:57.068619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:57.069314 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.069602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.069884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.070730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:57.072602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:57.074414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf427-d9f0-4202-8a8c-003ea439aa26 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:57.080944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:57.081862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.082174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.082521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] PATH_INFO: `/v3/users/da69a3d68c314a04a939490e2d3051ed` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.083679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da69a3d68c314a04a939490e2d3051ed)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:57.085643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:57.086999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1208/2372] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:20:57.090899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:57.103100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fda2f-0f65-4ead-b2d0-9ad4b00eecc0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:57.114746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:57.115431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.116014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.116354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.117141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:57.118794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:57.134180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1209/2373] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:20:57.135480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:57.146407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463f00-87b9-4b47-8eb0-77127539137d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:57.151701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6754c-90fe-4f90-abf7-9351d3a8e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:57.152628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6754c-90fe-4f90-abf7-9351d3a8e899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.157789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6754c-90fe-4f90-abf7-9351d3a8e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.157789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6754c-90fe-4f90-abf7-9351d3a8e899 admin admin] PATH_INFO: `/v3/projects/55f2507d26384db4a97b5bc46f4e55ba/users/5de5842af99a42378f2f59a6538fd6ca/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.168613 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6754c-90fe-4f90-abf7-9351d3a8e899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f2507d26384db4a97b5bc46f4e55ba, user_id=5de5842af99a42378f2f59a6538fd6ca, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:57.172098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6754c-90fe-4f90-abf7-9351d3a8e899 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:57.241408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1210/2374] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:20:57 2022] PUT /identity/v3/projects/55f2507d26384db4a97b5bc46f4e55ba/users/5de5842af99a42378f2f59a6538fd6ca/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:57.246477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.246765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.247040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.269749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:20:57.271027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:57.304375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da69a3d68c314a04a939490e2d3051ed'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:57.305052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da69a3d68c314a04a939490e2d3051ed'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:57.315543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da69a3d68c314a04a939490e2d3051ed'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:57.331157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da69a3d68c314a04a939490e2d3051ed'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:57.333203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da69a3d68c314a04a939490e2d3051ed'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:57.337756 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1211/2375] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:20:57.348144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:57.349600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:57.418375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1165/2376] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:56 2022] DELETE /identity/v3/users/da69a3d68c314a04a939490e2d3051ed => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:20:57.437597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86341-f9fa-4188-b709-488cc2e5141c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:57.500738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:57.501905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.502445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.502960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.583100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:57.584671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:57.597470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1212/2377] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:20:57.960212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:57.962268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:57.980976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410293f-d28a-4f6e-9fd2-1b13930a59f5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:57.987316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:57.988192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:57.989033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:57.989033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] PATH_INFO: `/v3/projects/6483c1a1ab2949bc87aa7cf219b7f7a0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:57.990244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6483c1a1ab2949bc87aa7cf219b7f7a0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:57.992717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:58.145982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6483c1a1ab2949bc87aa7cf219b7f7a0', 'request_id': 'req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.153639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6483c1a1ab2949bc87aa7cf219b7f7a0', 'request_id': 'req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.235390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6483c1a1ab2949bc87aa7cf219b7f7a0', 'request_id': 'req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.250562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] The token cache is being invalidate because project 6483c1a1ab2949bc87aa7cf219b7f7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:58.250870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.251503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.253217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1166/2378] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:57 2022] DELETE /identity/v3/projects/6483c1a1ab2949bc87aa7cf219b7f7a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:58.258604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:58.280470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd699-8301-4f9d-abf1-5c3eb5bb25ef service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:58.347456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:58.352622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:58.352622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:58.352622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] PATH_INFO: `/v3/users/64b13c5f914c4af5b222192c2f95e96f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:58.352622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b13c5f914c4af5b222192c2f95e96f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:58.352622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:58.544599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b13c5f914c4af5b222192c2f95e96f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.612333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b13c5f914c4af5b222192c2f95e96f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.624230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b13c5f914c4af5b222192c2f95e96f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.637382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b13c5f914c4af5b222192c2f95e96f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.638452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b13c5f914c4af5b222192c2f95e96f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:58.648290 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1213/2379] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:20:58 2022] DELETE /identity/v3/users/64b13c5f914c4af5b222192c2f95e96f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:20:59.281283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:20:59.282869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:20:59.296241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c340f26-0b28-4fd9-badd-3e5ddbd0e84b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:20:59.372556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:20:59.373503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:20:59.374046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:20:59.374339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] PATH_INFO: `/v3/projects/8464f13c82a848e2b336a389be1c2f19` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:20:59.375814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8464f13c82a848e2b336a389be1c2f19)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:20:59.377747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:20:59.538561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8464f13c82a848e2b336a389be1c2f19', 'request_id': 'req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:59.556003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8464f13c82a848e2b336a389be1c2f19', 'request_id': 'req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:59.625716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8464f13c82a848e2b336a389be1c2f19', 'request_id': 'req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:59.639573 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] The token cache is being invalidate because project 8464f13c82a848e2b336a389be1c2f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:20:59.640223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:59.640923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-f55cbc23-8522-47a2-9cfc-f9c1ad6c5d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:20:59.642568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1167/2380] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:20:59 2022] DELETE /identity/v3/projects/8464f13c82a848e2b336a389be1c2f19 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:21:05.378051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:05.379745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:05.415680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471c9b-6702-4d8b-b266-3a91bb455d7c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:05.544538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:05.545954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:05.546671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:05.552230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] PATH_INFO: `/v3/users/38bde804434f4994b80a0a286bedd6d5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:05.552230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bde804434f4994b80a0a286bedd6d5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:05.552230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:05.659954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:05.660489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:05.660489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:05.699069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] MFA Rules not processed for user `5de5842af99a42378f2f59a6538fd6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:05.702686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:05.789476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1168/2381] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:05.794267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:05.798642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:05.813134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3525d-7524-4fbf-b497-5f12a30bbcca None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:05.813465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bde804434f4994b80a0a286bedd6d5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:05.824419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:05.829477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:05.829477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:05.829477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:05.829477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:05.834785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:05.900077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bde804434f4994b80a0a286bedd6d5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:05.912662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bde804434f4994b80a0a286bedd6d5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:05.926868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bde804434f4994b80a0a286bedd6d5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:05.927711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3c281e78-6ebe-47f6-89c3-cc5902991cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bde804434f4994b80a0a286bedd6d5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:05.941710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1214/2382] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:21:05 2022] DELETE /identity/v3/users/38bde804434f4994b80a0a286bedd6d5 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:05.941710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:05.941710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:05.941710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:05.968852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1169/2383] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:21:05 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:21:05.973217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:05.975300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:05.979520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:05.981485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:06.110688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf8513-7727-4151-b6d6-9ec8aa92ee8b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:06.124303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:06.125660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.126354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.126955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.129633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:06.133399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:06.284326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1215/2384] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:06.284326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:06.284326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:06.310146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a1c92-41eb-4e79-81a1-8d55d3b0b234 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:06.314705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1170/2385] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:21:05 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:21:06.316543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:06.319562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:06.332340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:06.334411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.340040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.340040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] PATH_INFO: `/v3/users/cc2e37880aa74322b2bb19cf1ae4721c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.340040 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2e37880aa74322b2bb19cf1ae4721c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:06.346750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:06.440812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ce3f-a545-4f0e-8355-391ead153a8b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:06.444888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:06.445646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.445999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.446385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.459571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:06.461092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:06.472570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1171/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:06.475406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:06.487572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a329ad-a639-4fd4-91e9-40916f82f7ab service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:06.494431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:06.495327 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.495684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.496109 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.497015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:06.500378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:06.516982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1172/2387] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:21:06.528300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:06.533962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc41b1-0eb1-4af7-b3b9-010718c9240c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:06.540817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:06.542615 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.543495 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.543958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] PATH_INFO: `/v3/projects/d8e5d74db9094fe6a38fd11c6b7161fd/users/3ae3b2a52b25448393c22d99c2e4f8fc/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.587783 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e5d74db9094fe6a38fd11c6b7161fd, user_id=3ae3b2a52b25448393c22d99c2e4f8fc, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:06.596732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2e37880aa74322b2bb19cf1ae4721c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:06.597933 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:06.665637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2e37880aa74322b2bb19cf1ae4721c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:06.677470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2e37880aa74322b2bb19cf1ae4721c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:06.693683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2e37880aa74322b2bb19cf1ae4721c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:06.694338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c69bd385-4ce1-4db7-925f-fc10a3a99d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2e37880aa74322b2bb19cf1ae4721c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:06.700725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1173/2388] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:21:06 2022] PUT /identity/v3/projects/d8e5d74db9094fe6a38fd11c6b7161fd/users/3ae3b2a52b25448393c22d99c2e4f8fc/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:06.704103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:06.706400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:06.707029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1216/2389] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:21:06 2022] DELETE /identity/v3/users/cc2e37880aa74322b2bb19cf1ae4721c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:06.709149 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.709642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.710077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.748838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:06.750193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:06.813472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd59eb1-ba60-429e-be88-7fd906ff9397 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:06.909773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1217/2390] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:06.923107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:06.926730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:06.965454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:06.969373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:06.969771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:06.970068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:06.970909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:06.972633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:07.002677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1174/2391] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:21:07.009166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:07.035286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc7a5e-c5d7-4363-8845-2e6048aa1242 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:07.050033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:07.051875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:07.052152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:07.052434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] PATH_INFO: `/v3/projects/d8e5d74db9094fe6a38fd11c6b7161fd/users/3ae3b2a52b25448393c22d99c2e4f8fc/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:07.060539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e5d74db9094fe6a38fd11c6b7161fd, user_id=3ae3b2a52b25448393c22d99c2e4f8fc, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:07.064023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:07.090262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1175/2392] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:21:07 2022] PUT /identity/v3/projects/d8e5d74db9094fe6a38fd11c6b7161fd/users/3ae3b2a52b25448393c22d99c2e4f8fc/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:07.106639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d2f30-08d5-4b12-950e-d7263e35b489 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:07.223767 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:07.224881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:07.225419 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:07.225704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:07.255839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:07.258082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:07.407785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:07.409792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:07.425088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1218/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:07.490968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598e9ec-d3ec-457b-a5ba-5a054baf07a7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:07.501271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:07.504079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:07.504547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:07.504939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] PATH_INFO: `/v3/projects/324e97f44b034272b80f37f3f72f037b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:07.506982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] RBAC: Authorizing `identity:delete_project(project_id=324e97f44b034272b80f37f3f72f037b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:07.509604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:07.765180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324e97f44b034272b80f37f3f72f037b', 'request_id': 'req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:07.777585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324e97f44b034272b80f37f3f72f037b', 'request_id': 'req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:07.892309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324e97f44b034272b80f37f3f72f037b', 'request_id': 'req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:07.921793 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] The token cache is being invalidate because project 324e97f44b034272b80f37f3f72f037b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:21:07.922405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:07.923488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8c7e3f3b-e519-4d8f-952e-95dbfc6019db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:07.937770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1176/2394] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:21:07 2022] DELETE /identity/v3/projects/324e97f44b034272b80f37f3f72f037b => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:08.538209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:08.542395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:08.585308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0120ec-83a2-4e8e-acd0-5477239641de service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:08.675026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:08.676160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:08.676583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:08.677024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] PATH_INFO: `/v3/projects/e9affa1858784c7c97bbbbe63c4e1d9f` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:08.678483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9affa1858784c7c97bbbbe63c4e1d9f)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:08.680545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:08.812803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9affa1858784c7c97bbbbe63c4e1d9f', 'request_id': 'req-063ee36a-3b6e-4dd3-986b-914680efa141'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:08.820699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9affa1858784c7c97bbbbe63c4e1d9f', 'request_id': 'req-063ee36a-3b6e-4dd3-986b-914680efa141'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:08.932546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9affa1858784c7c97bbbbe63c4e1d9f', 'request_id': 'req-063ee36a-3b6e-4dd3-986b-914680efa141'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:08.970309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] The token cache is being invalidate because project e9affa1858784c7c97bbbbe63c4e1d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:21:08.970309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:08.972752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-063ee36a-3b6e-4dd3-986b-914680efa141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:08.977334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1219/2395] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:21:08 2022] DELETE /identity/v3/projects/e9affa1858784c7c97bbbbe63c4e1d9f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:08.984272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:08.984866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:08.985054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.020924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:09.022662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:09.227753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1177/2396] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:09.238034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.238362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.242837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.274090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:09.275518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:09.290234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1220/2397] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:21:09.294230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:09.305919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8c8b0-7759-449b-bbcc-23e00e88e7c7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:09.318072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:09.318798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.319087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.319361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.320529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:21:09.321730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:09.323446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:09.349708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:09.350315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1178/2398] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:21:09.362675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e6a51-37d9-4d1a-b21e-85f4a842550a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:09.377125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:09.382421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.382421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.382421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.382421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:09.382421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:09.602854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1221/2399] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:21:09 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:21:09.614215 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:09.618694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4885-dcc4-4ef5-9d4d-55ea1357fde5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:09.697406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:09.698097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.698442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.698723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.699436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:09.702134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:09.826935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:09.829365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1179/2400] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:21:09 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:21:09.846061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b8e5a-d7b2-4a4b-b880-cbe946c7e82c admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:09.853446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:09.854164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.854454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.854732 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.855480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:09.857676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:09.872838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1222/2401] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:21:09.881399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:09.901296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e3d1f-ed2d-4ccb-b04a-cd84c8b46663 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:09.911195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1148b95-cd20-499c-9251-635bffd8fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:09.912518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1148b95-cd20-499c-9251-635bffd8fb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.913106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1148b95-cd20-499c-9251-635bffd8fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.913663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1148b95-cd20-499c-9251-635bffd8fb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:09.914974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1148b95-cd20-499c-9251-635bffd8fb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:09.918132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1148b95-cd20-499c-9251-635bffd8fb74 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:09.949151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1180/2402] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:21:09.951675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:09.982981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd010a-9c42-490c-a9ba-61ad6535f9ee admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:09.989988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:09.990395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:09.990760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:09.990947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] PATH_INFO: `/v3/projects/ab17127fc9dd4c639842f605d435f7cd/users/91a89897bd8d4237ac9709baf645fe7d/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:10.034220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab17127fc9dd4c639842f605d435f7cd, user_id=91a89897bd8d4237ac9709baf645fe7d, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:10.040852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:10.142908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1223/2403] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:21:09 2022] PUT /identity/v3/projects/ab17127fc9dd4c639842f605d435f7cd/users/91a89897bd8d4237ac9709baf645fe7d/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:10.148290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4096a7-0d17-48f0-a819-f085618dd85b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:10.148864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4096a7-0d17-48f0-a819-f085618dd85b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:10.148864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4096a7-0d17-48f0-a819-f085618dd85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:10.195566 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ef4096a7-0d17-48f0-a819-f085618dd85b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:10.197937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ef4096a7-0d17-48f0-a819-f085618dd85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:10.408779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1181/2404] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:10.497318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:10.500112 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:10.630160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd75e4-b480-4908-9489-f5ce8dedfe14 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:10.634752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:10.635639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:10.636108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:10.636528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:10.648473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:10.650205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:10.665140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1224/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:17.532333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e5bcd-b855-4c14-b3fd-66b5ecb7fd7b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:17.533202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e5bcd-b855-4c14-b3fd-66b5ecb7fd7b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:17.533632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e5bcd-b855-4c14-b3fd-66b5ecb7fd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:17.573713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-349e5bcd-b855-4c14-b3fd-66b5ecb7fd7b None None] MFA Rules not processed for user `3ae3b2a52b25448393c22d99c2e4f8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:17.575326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-349e5bcd-b855-4c14-b3fd-66b5ecb7fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:17.682173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1182/2406] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:17.694566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:17.696041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:17.893511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36189fe-4528-45f9-bcb3-c94df8cfc69b service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:17.901104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:17.907881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:17.907881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:17.907881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:17.907881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:18.036989 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:18.039052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:18.067743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1225/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:20.647094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193edc3-1171-470c-89db-847e36961b20 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:20.647656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193edc3-1171-470c-89db-847e36961b20 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:20.647779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193edc3-1171-470c-89db-847e36961b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:20.695632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f193edc3-1171-470c-89db-847e36961b20 None None] MFA Rules not processed for user `91a89897bd8d4237ac9709baf645fe7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:20.698742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f193edc3-1171-470c-89db-847e36961b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:20.837137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1183/2408] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:20.844903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:20.860325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a81d-4794-4241-918c-a9aeaa82a0dd service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:20.866637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:20.867483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:20.867765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:20.868170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:20.868730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:20.870695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:20.979110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1226/2409] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:21:20 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:21:20.985182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193edc3-1171-470c-89db-847e36961b20 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:21.031642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193edc3-1171-470c-89db-847e36961b20 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:21.199919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:21.202340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:21.202711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:21.203148 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:21.204359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:21.207895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:21.322037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:21.331342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1184/2410] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:21:20 2022] POST /identity/v3/users => generated 299 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:21:21.349653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f108f8-ca5a-4479-a3ea-8098976d488e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:21.368485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:21.369430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:21.369871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:21.370346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:21.376201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:21.382820 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:21.421834 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:21.429931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1227/2411] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:21:21.443698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e93b75-8668-4bd8-9206-acafa2d94f5f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:21.451872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:21.453748 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:21.454447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:21.455065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] PATH_INFO: `/v3/projects/fc34840e9f9f4e3d9006d7c70b4e8e99/users/f80ad426b13940ee91fac77554ab3112/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:21.484235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc34840e9f9f4e3d9006d7c70b4e8e99, user_id=f80ad426b13940ee91fac77554ab3112, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:21.490667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:21.609811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1185/2412] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:21:21 2022] PUT /identity/v3/projects/fc34840e9f9f4e3d9006d7c70b4e8e99/users/f80ad426b13940ee91fac77554ab3112/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:21.613916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:21.634461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f548d4-cd49-47fa-a022-7dd239596337 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:21.799849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a89b1c-06c8-4bf3-81ae-a29ff05cda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:21.801975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89b1c-06c8-4bf3-81ae-a29ff05cda13 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:21.801975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89b1c-06c8-4bf3-81ae-a29ff05cda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:21.801975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89b1c-06c8-4bf3-81ae-a29ff05cda13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:21.801975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a89b1c-06c8-4bf3-81ae-a29ff05cda13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:21.803711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a89b1c-06c8-4bf3-81ae-a29ff05cda13 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:21.828675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1228/2413] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:21:21.832611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:21.848730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc537819-d938-4958-8697-02c87d41383e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:21.860145 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:21.861725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:21.862234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:21.862665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] PATH_INFO: `/v3/projects/fc34840e9f9f4e3d9006d7c70b4e8e99/users/f80ad426b13940ee91fac77554ab3112/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:21.866043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc34840e9f9f4e3d9006d7c70b4e8e99, user_id=f80ad426b13940ee91fac77554ab3112, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:21.869168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:21.885763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1186/2414] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:21:21 2022] PUT /identity/v3/projects/fc34840e9f9f4e3d9006d7c70b4e8e99/users/f80ad426b13940ee91fac77554ab3112/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:22.178060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24762788-ee35-401d-8f2b-607632cedb25 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:22.178573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24762788-ee35-401d-8f2b-607632cedb25 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:22.182074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24762788-ee35-401d-8f2b-607632cedb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:22.208383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-24762788-ee35-401d-8f2b-607632cedb25 None None] MFA Rules not processed for user `5de5842af99a42378f2f59a6538fd6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:22.209784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-24762788-ee35-401d-8f2b-607632cedb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:22.302722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1229/2415] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:24.416847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:24.420045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:24.643079 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6977-75be-424a-8e5d-9577bef7fb6c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:24.649502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:24.651017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:24.651555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:24.653124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:24.660103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:24.679825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:24.681900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:24.697582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1187/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:28.743846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d7a0-d2a1-43d8-99fb-752d3b616583 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:28.745205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d7a0-d2a1-43d8-99fb-752d3b616583 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:28.745701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4d7a0-d2a1-43d8-99fb-752d3b616583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:28.814265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a9e4d7a0-d2a1-43d8-99fb-752d3b616583 None None] MFA Rules not processed for user `f80ad426b13940ee91fac77554ab3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:28.815501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a9e4d7a0-d2a1-43d8-99fb-752d3b616583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:28.955017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1230/2417] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:28.972957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:28.974546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:29.132107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8e3a-ad9b-4de9-b49a-a8303c581735 service placement] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:29.145010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:29.145010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:29.145010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:29.145010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:29.240169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:29.242706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:29.258025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1188/2418] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:29.571232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:29.571573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:29.571859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:29.633512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:29.635273 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:29.751278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1231/2419] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:21:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:29.765307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:29.767441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:29.875340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256564-f2ca-4336-acbc-0ea428aca3cb service glance] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:29.880999 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a40abf-02c8-4ff2-9e64-207bc4ef07fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:29.881660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a40abf-02c8-4ff2-9e64-207bc4ef07fd service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:29.881946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a40abf-02c8-4ff2-9e64-207bc4ef07fd service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:29.882255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a40abf-02c8-4ff2-9e64-207bc4ef07fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:29.893070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a40abf-02c8-4ff2-9e64-207bc4ef07fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:29.894267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a40abf-02c8-4ff2-9e64-207bc4ef07fd service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:29.903069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1189/2420] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:21:35.479411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:35.481385 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:35.641177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105793aa-e0dd-4a9c-bf94-716b3c0a3b77 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:35.647959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:35.648978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:35.649289 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:35.649563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] PATH_INFO: `/v3/users/cc0787e110b04b4c821a7b33be5b6ac5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:35.651854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0787e110b04b4c821a7b33be5b6ac5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:35.665473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:35.882212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0787e110b04b4c821a7b33be5b6ac5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:36.012903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0787e110b04b4c821a7b33be5b6ac5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:36.028340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0787e110b04b4c821a7b33be5b6ac5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:36.043522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0787e110b04b4c821a7b33be5b6ac5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:36.044562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0787e110b04b4c821a7b33be5b6ac5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:36.052446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1232/2421] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:21:35 2022] DELETE /identity/v3/users/cc0787e110b04b4c821a7b33be5b6ac5 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:36.057149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:36.057767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:36.057767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:36.077461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:36.078249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:36.182445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1190/2422] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:36.197350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:36.200106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:36.305919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727a6a-a724-4b22-b8c0-ebac8c1f511d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:36.310167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad963c-a9f1-4564-86dd-795ff6c8b82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:36.310847 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad963c-a9f1-4564-86dd-795ff6c8b82e service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:36.311189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad963c-a9f1-4564-86dd-795ff6c8b82e service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:36.311417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad963c-a9f1-4564-86dd-795ff6c8b82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:36.322593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad963c-a9f1-4564-86dd-795ff6c8b82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:36.323844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad963c-a9f1-4564-86dd-795ff6c8b82e service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:36.338374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1233/2423] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:21:36.943250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:36.945299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:36.979146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c3bd4-5bc8-4f4e-b420-4710f6b5dced None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:37.000814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:37.002250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:37.002763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:37.011612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] PATH_INFO: `/v3/projects/68c2d525765b4848abd992e3c3c5ab54` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:37.014594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c2d525765b4848abd992e3c3c5ab54)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:37.020149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:37.126574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c2d525765b4848abd992e3c3c5ab54', 'request_id': 'req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:37.134300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c2d525765b4848abd992e3c3c5ab54', 'request_id': 'req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:37.217774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c2d525765b4848abd992e3c3c5ab54', 'request_id': 'req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:37.237990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] The token cache is being invalidate because project 68c2d525765b4848abd992e3c3c5ab54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:21:37.238424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:37.239210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ec6299a-ec0a-4049-94fb-bf5d29f6926d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:21:37.241518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1191/2424] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:21:36 2022] DELETE /identity/v3/projects/68c2d525765b4848abd992e3c3c5ab54 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:21:43.225092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:43.225680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:43.225680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:43.243132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] MFA Rules not processed for user `91a89897bd8d4237ac9709baf645fe7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:43.244353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:43.301535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1234/2425] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:47.278544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6237ec-1e5e-42b0-8ea4-82f9f094802e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:47.280576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6237ec-1e5e-42b0-8ea4-82f9f094802e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:47.281229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6237ec-1e5e-42b0-8ea4-82f9f094802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:47.306598 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-6b6237ec-1e5e-42b0-8ea4-82f9f094802e None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:47.308037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6b6237ec-1e5e-42b0-8ea4-82f9f094802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:47.408332 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1192/2426] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:21:47.409134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:21:47.410979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:47.514992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711aac2-dbd7-450f-9dd4-6b0c8956ce93 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:21:47.521329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:21:47.525812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:47.525812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:47.525812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:47.538048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:21:47.540215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:21:47.559522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1235/2427] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:21:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:21:48.971600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eabc2-29dd-4d64-9e46-d01769dc9c7a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:21:48.972151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eabc2-29dd-4d64-9e46-d01769dc9c7a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:21:48.972297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eabc2-29dd-4d64-9e46-d01769dc9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:21:48.992582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-226eabc2-29dd-4d64-9e46-d01769dc9c7a None None] MFA Rules not processed for user `e192d9ed33cc4852b691f9278242fdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:21:48.993802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-226eabc2-29dd-4d64-9e46-d01769dc9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:21:49.064271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1193/2428] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:21:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:22:16.444858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:22:16.446637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:22:16.521192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb317a-462c-411f-8de9-f56fe91dd480 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:22:16.524856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:22:16.525510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:22:16.525789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:22:16.526065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:22:16.527920 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:22:16.596252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:22:16.597681 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:22:16.607653 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1236/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:22:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:22:20.775285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c971-188a-448a-8405-a27638ae5b1e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:22:20.776273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c971-188a-448a-8405-a27638ae5b1e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:22:20.776557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c971-188a-448a-8405-a27638ae5b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:22:20.795111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-8c33c971-188a-448a-8405-a27638ae5b1e None None] MFA Rules not processed for user `af7e95f4699840629cda1680de65d77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:22:20.796319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8c33c971-188a-448a-8405-a27638ae5b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:22:20.852076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1194/2430] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:22:22.527533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:22:22.529630 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:22:22.541052 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3799c8a-8966-4904-a719-c4d5cda7030b service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:22:22.545879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:22:22.546579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:22:22.546987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:22:22.547240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:22:22.549026 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:22:22.624354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:22:22.626082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87573cf5-6841-4934-acfd-883ca937300a service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:22:22.642696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1237/2431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:22:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:23:19.814728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:19.815940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:19.815940 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:19.835672 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] MFA Rules not processed for user `1645581d13c54204a0f32a67738fd2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:23:19.836879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:19.892772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1195/2432] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:23:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:23:30.226284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:30.226870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:30.226870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:30.244171 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] MFA Rules not processed for user `e192d9ed33cc4852b691f9278242fdaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:23:30.245284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:30.252992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1238/2433] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:23:32.251094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:23:32.261422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f743d4-b098-450f-a751-ef2d765c7328 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:23:32.265105 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:23:32.265744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:32.271122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:32.271122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:32.271122 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:32.341514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:23:32.343008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:23:32.354538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1196/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:23:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:23:33.535012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:23:33.545264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757fce1-a725-4e18-8971-b25fc76b1844 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:23:33.548992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:23:33.549675 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:33.550002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:33.550222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:33.552018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:33.570380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:23:33.573571 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fd6ac-bc6a-41e2-9131-b68d8a5f5936 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:23:33.586407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1239/2435] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:23:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:23:40.136015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:23:40.137413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:40.161735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73b743-7da0-4ab2-a3ea-5f9fe13e8e0e service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:23:40.168945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:23:40.170741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:40.171605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:40.172181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:40.174465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:40.189040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:23:40.190698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:23:40.201656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1197/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:23:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:23:44.550447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:44.551004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:44.551174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:44.570973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] MFA Rules not processed for user `af7e95f4699840629cda1680de65d77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:23:44.572187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:44.580754 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1240/2437] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:23:45.500867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:23:45.502642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:45.582462 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca2c8a-efa3-4c75-8076-2d8d1512ad64 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:23:45.588919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:23:45.589914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:45.590232 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:45.590515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:45.592733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:45.605544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:23:45.607191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:23:45.618248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1198/2438] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:23:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:23:51.504794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:23:51.516134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8b9ca-90c7-4d64-a780-f60b7508b9f8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:23:51.521344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:23:51.522046 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:51.522365 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:51.522637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:51.524427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:51.534842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:23:51.536279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9c481-75b1-4c56-8fe6-e61fda76816c service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:23:51.545690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1241/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:23:59.292223 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:23:59.308571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526649f-2436-4241-97ce-10de1d019445 service placement] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:23:59.314546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:23:59.315205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:23:59.315486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:23:59.315761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:23:59.318484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:23:59.331946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:23:59.339358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:23:59.345614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1199/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:01.065310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:01.065866 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:01.066277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:01.086846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:01.088196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:01.096378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1242/2441] 10.222.0.49 () {58 vars in 967 bytes} [Mon Apr 11 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:24:01.142756 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:01.154295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5070-ff25-439a-8bca-00800cdde58f service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:01.159482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:01.160087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:01.160364 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:01.160640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:01.169730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:01.171542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:01.180901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1200/2442] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:24:10.499083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:10.509423 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:10.569940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7d61-81f1-49c9-92fa-78a141df2710 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:10.574527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:10.575586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:10.575854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:10.576127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] PATH_INFO: `/v3/users/91a89897bd8d4237ac9709baf645fe7d` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:10.577910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a89897bd8d4237ac9709baf645fe7d)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:10.580153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:10.755932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a89897bd8d4237ac9709baf645fe7d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:10.845850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a89897bd8d4237ac9709baf645fe7d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:10.854536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a89897bd8d4237ac9709baf645fe7d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:10.866878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a89897bd8d4237ac9709baf645fe7d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:10.867714 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a89897bd8d4237ac9709baf645fe7d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:10.877234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1243/2443] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:24:10 2022] DELETE /identity/v3/users/91a89897bd8d4237ac9709baf645fe7d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:24:11.241609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:11.253937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ede6c2-6d0e-489e-8684-650c20c980e6 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:11.325030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:11.325883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:11.326195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:11.326467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] PATH_INFO: `/v3/projects/ab17127fc9dd4c639842f605d435f7cd` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:11.327651 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab17127fc9dd4c639842f605d435f7cd)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:11.329553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:11.450210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab17127fc9dd4c639842f605d435f7cd', 'request_id': 'req-973c570c-7023-431f-806b-b4d49086379d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.456189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab17127fc9dd4c639842f605d435f7cd', 'request_id': 'req-973c570c-7023-431f-806b-b4d49086379d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.532393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab17127fc9dd4c639842f605d435f7cd', 'request_id': 'req-973c570c-7023-431f-806b-b4d49086379d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.545512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] The token cache is being invalidate because project ab17127fc9dd4c639842f605d435f7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:24:11.545891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.546585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.549226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1201/2444] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:24:11 2022] DELETE /identity/v3/projects/ab17127fc9dd4c639842f605d435f7cd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:24:11.553952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:11.555473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:11.569301 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77968d96-0997-4e69-b720-701b5812eb06 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:11.626548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:11.627420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:11.627696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:11.628220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] PATH_INFO: `/v3/users/f80ad426b13940ee91fac77554ab3112` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:11.629453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80ad426b13940ee91fac77554ab3112)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:11.632023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:11.842470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80ad426b13940ee91fac77554ab3112'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.943527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80ad426b13940ee91fac77554ab3112'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.951166 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80ad426b13940ee91fac77554ab3112'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.962978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80ad426b13940ee91fac77554ab3112'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.963695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80ad426b13940ee91fac77554ab3112'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:11.969848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1244/2445] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:24:11 2022] DELETE /identity/v3/users/f80ad426b13940ee91fac77554ab3112 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:24:12.265052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:12.270039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:12.284067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c570c-7023-431f-806b-b4d49086379d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:12.348194 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:12.349734 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:12.350129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:12.350656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] PATH_INFO: `/v3/projects/fc34840e9f9f4e3d9006d7c70b4e8e99` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:12.351754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc34840e9f9f4e3d9006d7c70b4e8e99)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:12.353705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:12.526476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc34840e9f9f4e3d9006d7c70b4e8e99', 'request_id': 'req-00c5d0ff-5142-4b87-942e-da5a4595c4ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:12.531746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc34840e9f9f4e3d9006d7c70b4e8e99', 'request_id': 'req-00c5d0ff-5142-4b87-942e-da5a4595c4ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:12.605891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc34840e9f9f4e3d9006d7c70b4e8e99', 'request_id': 'req-00c5d0ff-5142-4b87-942e-da5a4595c4ba'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:12.617986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] The token cache is being invalidate because project fc34840e9f9f4e3d9006d7c70b4e8e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:24:12.618366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:12.618976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:12.620580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1202/2446] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:24:12 2022] DELETE /identity/v3/projects/fc34840e9f9f4e3d9006d7c70b4e8e99 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:24:12.742522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:12.744278 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:12.845696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda464c-5924-4ac5-af5d-eb7c2fc2d5be admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:12.911347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:12.912348 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:12.912629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:12.912909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:12.914913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:12.972787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:12.974400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:12.983386 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1245/2447] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:38.731076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:38.732538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:38.816793 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d0ff-5142-4b87-942e-da5a4595c4ba admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:38.821708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:38.822736 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:38.823015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:38.823285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] PATH_INFO: `/v3/users/e192d9ed33cc4852b691f9278242fdaa` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:38.824484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e192d9ed33cc4852b691f9278242fdaa)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:38.826433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:39.073062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e192d9ed33cc4852b691f9278242fdaa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.074063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e192d9ed33cc4852b691f9278242fdaa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.083765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e192d9ed33cc4852b691f9278242fdaa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.098053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e192d9ed33cc4852b691f9278242fdaa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.098871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-99b2511d-439f-4877-88b8-b2618f0c93ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e192d9ed33cc4852b691f9278242fdaa'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.217496 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1203/2448] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:24:38 2022] DELETE /identity/v3/users/e192d9ed33cc4852b691f9278242fdaa => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:24:39.529532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:39.541535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0001-26ab-4609-8478-58639af4e16f service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:39.601204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:39.602200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:39.602482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:39.602757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] PATH_INFO: `/v3/projects/3c7a1b34470341c88e3b1f1eefd94c52` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:39.603991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7a1b34470341c88e3b1f1eefd94c52)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:39.605958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:39.763451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7a1b34470341c88e3b1f1eefd94c52', 'request_id': 'req-1c9b3fa9-8321-4cee-9148-961cc8f728fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.769126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7a1b34470341c88e3b1f1eefd94c52', 'request_id': 'req-1c9b3fa9-8321-4cee-9148-961cc8f728fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.880895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7a1b34470341c88e3b1f1eefd94c52', 'request_id': 'req-1c9b3fa9-8321-4cee-9148-961cc8f728fe'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.894792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] The token cache is being invalidate because project 3c7a1b34470341c88e3b1f1eefd94c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:24:39.894792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.894792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1c9b3fa9-8321-4cee-9148-961cc8f728fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:24:39.897839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1246/2449] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:24:39 2022] DELETE /identity/v3/projects/3c7a1b34470341c88e3b1f1eefd94c52 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:24:39.902828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:39.903290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:39.903417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:39.922460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:39.923694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:39.995423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1204/2450] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:24:40.004226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.004547 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.004830 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.027054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:40.028445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:40.037110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1247/2451] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:24:40.042209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.052091 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660a30c-6dfa-4de9-800c-65cbd566a91d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.058093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.058804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.059664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.059664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.060229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:24:40.060540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.062191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.081384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1205/2452] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:24:40.082870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.093431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a8dd2-5f56-498d-b5a1-a673f671d9ad None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.099429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.104106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.104106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.104106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.104106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.104106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.236315 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1248/2453] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:24:40 2022] POST /identity/v3/projects => generated 389 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:24:40.240476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.251825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704eca-24ae-480b-8e22-07555a1ffaac admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.326466 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.327243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.327877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.327877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.328636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.330556 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.385634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.387440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:40.449962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1206/2454] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:24:40 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:24:40.450226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519c488-b57c-43b8-858a-bba7ccdd3839 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.451529 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.456249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.457015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.457363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.457639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.460905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:40.462545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36f410-8f6e-45f9-a861-72260feb0d72 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.468504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.468865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.479675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.479675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.479675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.479675 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.480127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.480127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.483415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1207/2455] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:24:40.486451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1249/2456] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:24:40.492216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.503937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354f30f-c61c-469b-886c-77308f9a48a2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.509564 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21d58-1d3b-42d4-b352-6dd35b5a2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.511773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21d58-1d3b-42d4-b352-6dd35b5a2864 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.511773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21d58-1d3b-42d4-b352-6dd35b5a2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.511773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21d58-1d3b-42d4-b352-6dd35b5a2864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.513601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21d58-1d3b-42d4-b352-6dd35b5a2864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.515487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21d58-1d3b-42d4-b352-6dd35b5a2864 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.528658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1208/2457] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:24:40.533666 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.552452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333ccf-4689-4329-8038-41e46912df65 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.557785 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.558773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.559048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.559354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] PATH_INFO: `/v3/projects/4b0f1fe37bda4d2c93681cc6b37d690c/users/8606d71db6ef4957a055466af7de83b6/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.574565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0f1fe37bda4d2c93681cc6b37d690c, user_id=8606d71db6ef4957a055466af7de83b6, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:40.577382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:40.744333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1250/2458] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:24:40 2022] PUT /identity/v3/projects/4b0f1fe37bda4d2c93681cc6b37d690c/users/8606d71db6ef4957a055466af7de83b6/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:24:40.749527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425fcef-3d2f-4dce-8557-c44cf5ce9a96 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.749810 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425fcef-3d2f-4dce-8557-c44cf5ce9a96 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.750083 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425fcef-3d2f-4dce-8557-c44cf5ce9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.769894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4425fcef-3d2f-4dce-8557-c44cf5ce9a96 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:40.771150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4425fcef-3d2f-4dce-8557-c44cf5ce9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:40.841029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1209/2459] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:24:40.854717 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:40.862991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:40.880989 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257c2e-0ffd-44f7-94ec-b6dd8da00e8b None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.881365 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257c2e-0ffd-44f7-94ec-b6dd8da00e8b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.881641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257c2e-0ffd-44f7-94ec-b6dd8da00e8b None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.890893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1210/2460] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:24:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:24:40.901959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.902266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.902621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:40.951831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:40.960434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:40.976619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ab402-fa09-406e-81da-62a5b13154df admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:40.985060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1211/2461] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:24:40.986542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac79f00-ef84-40ea-bec2-889a8ad111dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:40.987461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac79f00-ef84-40ea-bec2-889a8ad111dc service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:40.987980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac79f00-ef84-40ea-bec2-889a8ad111dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:40.988361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac79f00-ef84-40ea-bec2-889a8ad111dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:41.000280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:41.003380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac79f00-ef84-40ea-bec2-889a8ad111dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:41.005329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac79f00-ef84-40ea-bec2-889a8ad111dc service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:41.014816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bf64-174b-426f-aefe-7581c2704382 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:41.024299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6bb1-b8af-435b-96e6-500f874a6a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:41.024977 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6bb1-b8af-435b-96e6-500f874a6a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:41.025281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6bb1-b8af-435b-96e6-500f874a6a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:41.025638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1251/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:41.025768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6bb1-b8af-435b-96e6-500f874a6a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:41.042053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6bb1-b8af-435b-96e6-500f874a6a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:41.043870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6bb1-b8af-435b-96e6-500f874a6a22 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:41.056671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1212/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:24:41.153021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe8f1-3c06-4421-9411-53327adb30f0 None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:41.153225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe8f1-3c06-4421-9411-53327adb30f0 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:41.153481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe8f1-3c06-4421-9411-53327adb30f0 None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:41.155034 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1252/2464] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:24:41.161141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:41.162513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:41.162513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:41.204407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:41.205625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:41.292855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1213/2465] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:24:41.304371 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfe8f1-3c06-4421-9411-53327adb30f0 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:41.317094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfe8f1-3c06-4421-9411-53327adb30f0 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:41.325232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1157b-0ed3-4139-8f9b-67494ce2fa99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:41.326839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1157b-0ed3-4139-8f9b-67494ce2fa99 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:41.334182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1157b-0ed3-4139-8f9b-67494ce2fa99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:41.334182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1157b-0ed3-4139-8f9b-67494ce2fa99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:41.344019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1157b-0ed3-4139-8f9b-67494ce2fa99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:41.345952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1157b-0ed3-4139-8f9b-67494ce2fa99 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:41.372232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1253/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:42.905901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:42.907613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:42.922356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c014-a575-4be5-93a1-2187d20e8c32 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:42.929458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:42.930302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:42.930584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:42.930864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:42.932788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:42.946550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:42.948163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:42.959592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1214/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:46.954644 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca353f6-9b31-4bee-ba09-57b2cf73568f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:46.958633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca353f6-9b31-4bee-ba09-57b2cf73568f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:46.960224 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca353f6-9b31-4bee-ba09-57b2cf73568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:46.989136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7ca353f6-9b31-4bee-ba09-57b2cf73568f None None] MFA Rules not processed for user `8606d71db6ef4957a055466af7de83b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:46.990387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7ca353f6-9b31-4bee-ba09-57b2cf73568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:47.089024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1254/2468] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:24:47.102939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:47.104367 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:47.120792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1528f-da23-4d48-b6f3-384a7052f6dd service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:47.129900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:47.130753 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:47.131389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:47.131878 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:47.141502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:47.150064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:47.180536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1215/2469] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:50.170293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:50.170747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:50.170890 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:50.192003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] MFA Rules not processed for user `8606d71db6ef4957a055466af7de83b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:24:50.193222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:50.201282 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1255/2470] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:24:50.569034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:50.579137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be258ecb-2c43-42d8-9533-a03ca9f61543 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:50.583121 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:50.584026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:50.584847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:50.585503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:50.587392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:50.598886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:50.601228 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:50.610531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1216/2471] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:24:57.870565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:24:57.900120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42a99-a7b4-4b30-bc80-4a1fce5ac675 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:24:57.907789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:24:57.908487 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:24:57.908739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:24:57.909184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:24:57.911220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:24:57.932132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:24:57.940566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:24:57.965271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1256/2472] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:24:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:05.213632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:05.223692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173489-fecc-4933-8aab-41166f2aa446 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:05.229169 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:05.230014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:05.230428 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:05.230775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:05.232690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:05.245886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:05.247517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:05.258861 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1217/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:05.722886 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:05.732318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84a293-6763-4206-8b64-63d55b608ba3 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:05.739369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:05.740087 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:05.740435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:05.740807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:05.743576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:05.757443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:05.763623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:05.773342 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1257/2474] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:10.180602 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:10.182371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:10.200732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc4274-eb5a-4886-88f7-898c5d898ef9 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:10.208571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:10.210434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:10.210908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:10.211333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] PATH_INFO: `/v3/users/af7e95f4699840629cda1680de65d77f` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:10.214649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7e95f4699840629cda1680de65d77f)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:10.216986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:10.505530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7e95f4699840629cda1680de65d77f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:10.506094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7e95f4699840629cda1680de65d77f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:10.513647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7e95f4699840629cda1680de65d77f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:10.526057 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7e95f4699840629cda1680de65d77f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:10.526794 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7e95f4699840629cda1680de65d77f'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:10.652939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1218/2475] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:10 2022] DELETE /identity/v3/users/af7e95f4699840629cda1680de65d77f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:10.952703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:10.964328 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fca53-a256-45d7-8244-ab6416f45cd4 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.062650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.063542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.063821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.064099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] PATH_INFO: `/v3/projects/70f9bb59f05040b99068fef7330a756a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.066285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f9bb59f05040b99068fef7330a756a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.066285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.201226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f9bb59f05040b99068fef7330a756a', 'request_id': 'req-517c0f37-420c-4398-b9dd-a6f48b49752b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.206692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f9bb59f05040b99068fef7330a756a', 'request_id': 'req-517c0f37-420c-4398-b9dd-a6f48b49752b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.277398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.279011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:11.279312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f9bb59f05040b99068fef7330a756a', 'request_id': 'req-517c0f37-420c-4398-b9dd-a6f48b49752b'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.293623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] The token cache is being invalidate because project 70f9bb59f05040b99068fef7330a756a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:11.293918 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.294608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-517c0f37-420c-4398-b9dd-a6f48b49752b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.294817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400073-5831-43b3-9846-2c8578f9ce69 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.296294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1258/2476] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:10 2022] DELETE /identity/v3/projects/70f9bb59f05040b99068fef7330a756a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:11.301005 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea23d5-8a10-4aef-8ea7-23dca4f0cbec None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.301245 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea23d5-8a10-4aef-8ea7-23dca4f0cbec None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.301531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea23d5-8a10-4aef-8ea7-23dca4f0cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.321103 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4eea23d5-8a10-4aef-8ea7-23dca4f0cbec None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:11.322475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4eea23d5-8a10-4aef-8ea7-23dca4f0cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:11.360039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.360956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.361234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.361502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] PATH_INFO: `/v3/users/1645581d13c54204a0f32a67738fd2a0` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.362714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1645581d13c54204a0f32a67738fd2a0)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.364772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.384626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1259/2477] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:11.392809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.392809 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.393596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.414867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:11.416058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:11.423972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1260/2478] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:11.428101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.436841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4fc07-3096-4a2a-babb-1b580ff7903a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.441399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.444488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.444488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.444488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.444488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:11.444488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.445307 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.456462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1261/2479] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:25:11.461329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.470619 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7942869-4f09-4040-811a-684b53e3e6bd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.478919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.478919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.478919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.478919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.479310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.479726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.608013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1262/2480] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:11 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:11.612104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.630588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1645581d13c54204a0f32a67738fd2a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.631318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1645581d13c54204a0f32a67738fd2a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.638604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1645581d13c54204a0f32a67738fd2a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.650795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1645581d13c54204a0f32a67738fd2a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.651481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1645581d13c54204a0f32a67738fd2a0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:11.672540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae4f5-91b3-475c-92bc-64f4e4d1c300 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.677411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.679318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.679318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.679318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.679713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.681430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.731292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1219/2481] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:11 2022] DELETE /identity/v3/users/1645581d13c54204a0f32a67738fd2a0 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:11.755963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1263/2482] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:11 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:11.760410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.762034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:11.826045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a04c0c-68ca-462b-8b4c-a73cc63bf2e7 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.830867 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.831595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.831897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.832157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.833077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.835388 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.848376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1220/2483] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:11.849647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.860514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a472-6f4b-4fee-9b33-2ede19a5ea4e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.865241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.866000 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.866334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.866610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.867340 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.868935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.878838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1264/2484] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:11.884163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.894192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5000b-dc03-40ae-8358-66eef084e7b1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:11.899795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84c59-7dc3-46e2-ba84-9ca368c798d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:11.900727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84c59-7dc3-46e2-ba84-9ca368c798d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:11.901010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84c59-7dc3-46e2-ba84-9ca368c798d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:11.901288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84c59-7dc3-46e2-ba84-9ca368c798d7 admin admin] PATH_INFO: `/v3/projects/ffe9e153f2fb4e1aaa9b8e8086528c3b/users/43c88c93d18d40e286785befb98fe630/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:11.915943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84c59-7dc3-46e2-ba84-9ca368c798d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe9e153f2fb4e1aaa9b8e8086528c3b, user_id=43c88c93d18d40e286785befb98fe630, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:11.918611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84c59-7dc3-46e2-ba84-9ca368c798d7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:11.990414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:11.992275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.008906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4be8-3137-4056-ad03-4b72658685b1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.014142 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1221/2485] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:11 2022] PUT /identity/v3/projects/ffe9e153f2fb4e1aaa9b8e8086528c3b/users/43c88c93d18d40e286785befb98fe630/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:12.028645 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.029015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.029356 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.056366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] MFA Rules not processed for user `43c88c93d18d40e286785befb98fe630`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:12.057575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.068403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.070321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.070606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.070884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] PATH_INFO: `/v3/projects/6da835078df84f0ab2e0221f23a79b65` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.072135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da835078df84f0ab2e0221f23a79b65)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.074030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.121938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1222/2486] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:12.126383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.138581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a568b76-d14a-48eb-8ff1-b910ea6fdf2a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.143744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.144448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.144760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.145073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.145832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.148380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.185194 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da835078df84f0ab2e0221f23a79b65', 'request_id': 'req-c4c5e672-f210-4160-b5d8-68398cd8d58c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:12.190718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da835078df84f0ab2e0221f23a79b65', 'request_id': 'req-c4c5e672-f210-4160-b5d8-68398cd8d58c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:12.241846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1223/2487] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:12.245978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.268931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da835078df84f0ab2e0221f23a79b65', 'request_id': 'req-c4c5e672-f210-4160-b5d8-68398cd8d58c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:12.280451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] The token cache is being invalidate because project 6da835078df84f0ab2e0221f23a79b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:12.280814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:12.281382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c4c5e672-f210-4160-b5d8-68398cd8d58c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:12.282985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1265/2488] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:11 2022] DELETE /identity/v3/projects/6da835078df84f0ab2e0221f23a79b65 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:12.288104 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974705e-317d-48d2-b115-7129b2a93282 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.288480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974705e-317d-48d2-b115-7129b2a93282 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.288834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974705e-317d-48d2-b115-7129b2a93282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.307083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7974705e-317d-48d2-b115-7129b2a93282 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:12.307317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5444d-31c3-41c3-9d68-503d55113a9f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.308260 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7974705e-317d-48d2-b115-7129b2a93282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.312401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.313077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.313363 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.313641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.314376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.316173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1266/2489] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:12.316593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.324592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.324879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.325159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.344162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:12.345367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.353606 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1267/2490] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:12.363979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.374518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def56a-f423-4623-8682-3b2a208ef100 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.379561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.380208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.380490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.380765 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.382142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:12.382431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.384023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.396118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1268/2491] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:25:12.404411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.414484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5a4a-7087-4c51-9acd-02cdea21f46e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.419086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.419856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.420131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.420405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.421158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.422985 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.429686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1224/2492] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:12.444196 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.446341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.458097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e669-6b5c-467f-ad43-8eb887d020d9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.463056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.463704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.463981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.464253 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.464970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.466572 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.477226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1225/2493] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:12.481147 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.490449 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6046bc-150c-4388-9eea-de70da576207 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.495885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.496723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.497045 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.497287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] PATH_INFO: `/v3/projects/b51a28c1125d4a7da716d89f1007f4a2/users/1542e1c12c5946dd8d3d24011e4e349e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.512234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51a28c1125d4a7da716d89f1007f4a2, user_id=1542e1c12c5946dd8d3d24011e4e349e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.515081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.539608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1269/2494] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:12.543878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.603157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c3962-556b-4833-941e-e702ca2a3561 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.607876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.610519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.610519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.610519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.610519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.611662 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.628849 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1226/2495] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:12 2022] PUT /identity/v3/projects/b51a28c1125d4a7da716d89f1007f4a2/users/1542e1c12c5946dd8d3d24011e4e349e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:12.632996 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.691573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1270/2496] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:12.693637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8067d-436d-4097-b841-d8c41340e865 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.695818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.698485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.699180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.699474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.699741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.700611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.702805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.705400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843803-3183-40f9-96a8-138db31a0af8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.710326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.710992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.711276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.711556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.712284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.713869 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.717384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1227/2497] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:12.718403 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.724165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1271/2498] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:12.729102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.729514 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db78fd-d493-4232-95b5-a2f5f308adbf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.734152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.735068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.735353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.735658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] PATH_INFO: `/v3/projects/b51a28c1125d4a7da716d89f1007f4a2/users/1542e1c12c5946dd8d3d24011e4e349e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.737654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51a28c1125d4a7da716d89f1007f4a2, user_id=1542e1c12c5946dd8d3d24011e4e349e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.738583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda3d42-e41a-4b08-9b08-636abf587173 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.740314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.743743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728db387-ea4f-4a37-b7e8-f08637551bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.744389 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db387-ea4f-4a37-b7e8-f08637551bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.744671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db387-ea4f-4a37-b7e8-f08637551bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.744945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db387-ea4f-4a37-b7e8-f08637551bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.745660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728db387-ea4f-4a37-b7e8-f08637551bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.747252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728db387-ea4f-4a37-b7e8-f08637551bc9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.751271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1228/2499] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:12 2022] PUT /identity/v3/projects/b51a28c1125d4a7da716d89f1007f4a2/users/1542e1c12c5946dd8d3d24011e4e349e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:12.757782 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1272/2500] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:12.762139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.763210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.763503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.763775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.789591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] MFA Rules not processed for user `1542e1c12c5946dd8d3d24011e4e349e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:12.791246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.826451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe50a7-65fa-4eef-a133-b506a1292f41 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.831124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f3b-7589-4a46-816d-d199db38721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.831995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f3b-7589-4a46-816d-d199db38721a admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.832277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f3b-7589-4a46-816d-d199db38721a admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.832554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f3b-7589-4a46-816d-d199db38721a admin admin] PATH_INFO: `/v3/projects/552390484855498ea9bb8450db6c3864/users/085189bd517d4b43abe0168732e61cb9/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.846537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6f3b-7589-4a46-816d-d199db38721a admin admin] RBAC: Authorizing `identity:create_grant(project_id=552390484855498ea9bb8450db6c3864, user_id=085189bd517d4b43abe0168732e61cb9, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:12.849178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6f3b-7589-4a46-816d-d199db38721a admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:12.856893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1273/2501] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:12.874324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:12.875683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.913362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1229/2502] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:12 2022] PUT /identity/v3/projects/552390484855498ea9bb8450db6c3864/users/085189bd517d4b43abe0168732e61cb9/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:12.925027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.925308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.925584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:12.931787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023082-60df-49a6-a9b3-131429035d8c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:12.953667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] MFA Rules not processed for user `085189bd517d4b43abe0168732e61cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:12.954994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:12.982495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:12.983145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:12.983425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:12.983704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.022747 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1230/2503] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:13.027132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.043125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.044563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.055049 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1274/2504] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:13.089322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac88c4-de2e-4011-99d2-10aec50dd628 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.094798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.095453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.095872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.096149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.096836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.098752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.181358 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.191892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aebaee-2a38-4546-91dc-8830ac9252db service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.197637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.202791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.202791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.202791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] PATH_INFO: `/v3/users/43c88c93d18d40e286785befb98fe630` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.202791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c88c93d18d40e286785befb98fe630)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.203264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1231/2505] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:13 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:13.203378 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.205386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.264579 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045945f-a822-4a50-91f3-ac3158578c27 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.269308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.269972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.270287 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.270563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.271247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.273360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.387283 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1232/2506] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:13 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:13.388558 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.398887 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be878-862a-42d3-a22a-1a5212a2d14b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.403604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.404282 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.404596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.404880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.405643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.407265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.414326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c88c93d18d40e286785befb98fe630'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:13.421098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1233/2507] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:13.422244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.432394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8106-ff74-4f0c-b7ec-3a58f5fff3e9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.437077 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.439487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.439487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.439487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] PATH_INFO: `/v3/projects/3153e07b8d5b4297bd61a9d5dff5adeb/users/0c2fc9e075664748b72f0d65e9b23c35/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.452850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3153e07b8d5b4297bd61a9d5dff5adeb, user_id=0c2fc9e075664748b72f0d65e9b23c35, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.455669 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.485770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c88c93d18d40e286785befb98fe630'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:13.493515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c88c93d18d40e286785befb98fe630'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:13.505215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c88c93d18d40e286785befb98fe630'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:13.505850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c09003a-b9a7-43cc-8b3e-83b4d2e71bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c88c93d18d40e286785befb98fe630'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:13.511697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1275/2508] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:13 2022] DELETE /identity/v3/users/43c88c93d18d40e286785befb98fe630 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:13.516023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.516326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.516588 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.520199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1234/2509] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:13 2022] PUT /identity/v3/projects/3153e07b8d5b4297bd61a9d5dff5adeb/users/0c2fc9e075664748b72f0d65e9b23c35/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:13.526421 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.528034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:13.538321 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:13.539569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:13.590905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e427f-0f7f-4d45-884e-94b585918eff admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.595741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.597870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.597870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.597870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.597870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.598316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1276/2510] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:13.599312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.608567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.610038 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:13.610450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1235/2511] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:13.614324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.624705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0761c9-4d2d-4793-ac6c-324102bcabfa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.629685 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eb2d6-7028-4fdb-b23d-5f582d1b29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.630622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eb2d6-7028-4fdb-b23d-5f582d1b29a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.630910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eb2d6-7028-4fdb-b23d-5f582d1b29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.631235 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eb2d6-7028-4fdb-b23d-5f582d1b29a7 admin admin] PATH_INFO: `/v3/projects/3153e07b8d5b4297bd61a9d5dff5adeb/users/0c2fc9e075664748b72f0d65e9b23c35/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.633757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eb2d6-7028-4fdb-b23d-5f582d1b29a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3153e07b8d5b4297bd61a9d5dff5adeb, user_id=0c2fc9e075664748b72f0d65e9b23c35, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.636479 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eb2d6-7028-4fdb-b23d-5f582d1b29a7 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.646508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1236/2512] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:13 2022] PUT /identity/v3/projects/3153e07b8d5b4297bd61a9d5dff5adeb/users/0c2fc9e075664748b72f0d65e9b23c35/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:13.657230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.657519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.657796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.668682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63718e2d-ca14-4441-aabc-9705acf32e01 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.684979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] MFA Rules not processed for user `0c2fc9e075664748b72f0d65e9b23c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:13.686435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:13.718239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.719188 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.719475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.719745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.755315 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1237/2513] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:13.767671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:13.769054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:13.783593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.785056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.794558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1277/2514] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:13.826965 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0de1-661f-45db-bdc6-f575becca42d None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:13.830711 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:13.831425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:13.831709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:13.831981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:13.841531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:13.843370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:13.854189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1238/2515] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:14.106943 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:14.117152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3debc-b1ee-40cf-98e9-f68ec0f109ea service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:14.120970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:14.121711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:14.122002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:14.122388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:14.124353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:14.185947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:14.187421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:14.196434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1278/2516] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:14.288454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:14.289942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:14.304132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225268f-3f1c-49f4-ae76-7e686f2bd0e3 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:14.309180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:14.310055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:14.310381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:14.310634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] PATH_INFO: `/v3/projects/ffe9e153f2fb4e1aaa9b8e8086528c3b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:14.311845 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe9e153f2fb4e1aaa9b8e8086528c3b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:14.313755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:14.439784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe9e153f2fb4e1aaa9b8e8086528c3b', 'request_id': 'req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.445203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe9e153f2fb4e1aaa9b8e8086528c3b', 'request_id': 'req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.571692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe9e153f2fb4e1aaa9b8e8086528c3b', 'request_id': 'req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.582758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] The token cache is being invalidate because project ffe9e153f2fb4e1aaa9b8e8086528c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:14.583042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.583667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.585980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1239/2517] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:14 2022] DELETE /identity/v3/projects/ffe9e153f2fb4e1aaa9b8e8086528c3b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:14.590076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:14.601426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0417a45-4522-47be-96cf-a589d912860f service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:14.675581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:14.676797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:14.677151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:14.677486 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] PATH_INFO: `/v3/users/1542e1c12c5946dd8d3d24011e4e349e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:14.682633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1542e1c12c5946dd8d3d24011e4e349e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:14.684628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:14.875583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1542e1c12c5946dd8d3d24011e4e349e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.954267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1542e1c12c5946dd8d3d24011e4e349e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.962003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1542e1c12c5946dd8d3d24011e4e349e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.973366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1542e1c12c5946dd8d3d24011e4e349e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.975223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4363f359-f1ae-49c9-a98d-ea736b9324d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1542e1c12c5946dd8d3d24011e4e349e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:14.979995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1279/2518] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:14 2022] DELETE /identity/v3/users/1542e1c12c5946dd8d3d24011e4e349e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:15.396791 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:15.398724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:15.416376 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f760-022e-4d8a-bfaf-06ebfecd8e48 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:15.490463 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:15.491937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:15.492266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:15.492546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] PATH_INFO: `/v3/projects/b51a28c1125d4a7da716d89f1007f4a2` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:15.493782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51a28c1125d4a7da716d89f1007f4a2)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:15.495751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:15.619312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51a28c1125d4a7da716d89f1007f4a2', 'request_id': 'req-440c8675-f2be-41b1-a48c-8c01689e060d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:15.625325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51a28c1125d4a7da716d89f1007f4a2', 'request_id': 'req-440c8675-f2be-41b1-a48c-8c01689e060d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:15.691355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51a28c1125d4a7da716d89f1007f4a2', 'request_id': 'req-440c8675-f2be-41b1-a48c-8c01689e060d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:15.705191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] The token cache is being invalidate because project b51a28c1125d4a7da716d89f1007f4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:15.705621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:15.706339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-440c8675-f2be-41b1-a48c-8c01689e060d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:15.707978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1240/2519] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:15 2022] DELETE /identity/v3/projects/b51a28c1125d4a7da716d89f1007f4a2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:15.713063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:15.713582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:15.713698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:15.734275 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:15.735533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:15.797706 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1280/2520] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:15.806516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:15.806804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:15.807088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:15.826656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:15.827864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:15.836581 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1241/2521] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:15.841164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:15.852128 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edee63-55ea-44e5-b387-bec0e01ef4e5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:15.857021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:15.857707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:15.857987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:15.858297 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:15.859023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:15.859329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:15.860929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:15.873643 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1281/2522] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:25:15.878063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:15.887420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17083d-c844-401d-82c7-3f3fd20e6e94 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:15.896583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:15.896583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:15.896583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:15.896583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:15.897697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:15.897697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.001298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1242/2523] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:15 2022] POST /identity/v3/projects => generated 409 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:16.008801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.023233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80692f13-e7c8-4ca3-a1c4-b141e5df3b33 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.085123 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.085889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.086294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.086550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.087247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.089183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.223250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1282/2524] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:16 2022] POST /identity/v3/users => generated 305 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:16.227460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.239978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784adba-c433-4eda-a794-677d6a8ba3ea admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.244694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.245359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.245637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.245911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.246676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.248278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.261397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1243/2525] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:16.269137 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.280019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c15336-496b-4414-af74-2a92364908b5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.284913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa434-fac2-4d5d-aedd-fcf2b25076a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.285580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa434-fac2-4d5d-aedd-fcf2b25076a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.285868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa434-fac2-4d5d-aedd-fcf2b25076a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.286174 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa434-fac2-4d5d-aedd-fcf2b25076a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.286907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa434-fac2-4d5d-aedd-fcf2b25076a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.288481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa434-fac2-4d5d-aedd-fcf2b25076a5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.299247 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1283/2526] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:16.303807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.313652 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de079c-0471-48d7-9a9b-86573fd99101 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.318155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.319586 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.319902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.320284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] PATH_INFO: `/v3/projects/205d030547fc47cc9b9a09829f2e2d74/users/ea4fb8bd9643465087f0415cbb273c38/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.335406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=205d030547fc47cc9b9a09829f2e2d74, user_id=ea4fb8bd9643465087f0415cbb273c38, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.338027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.417238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1244/2527] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:16 2022] PUT /identity/v3/projects/205d030547fc47cc9b9a09829f2e2d74/users/ea4fb8bd9643465087f0415cbb273c38/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:16.427267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.427554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.427831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.454153 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] MFA Rules not processed for user `ea4fb8bd9643465087f0415cbb273c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:16.455351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:16.519913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1284/2528] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:16.525013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.583281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c43e88-b4ef-4b62-9c0d-4b89f8989dbc admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.588172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70931286-1506-462a-8730-67d7a035070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.588824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70931286-1506-462a-8730-67d7a035070c admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.589104 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70931286-1506-462a-8730-67d7a035070c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.589375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70931286-1506-462a-8730-67d7a035070c admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.590065 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70931286-1506-462a-8730-67d7a035070c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.591978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70931286-1506-462a-8730-67d7a035070c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.699664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1245/2529] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:16 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:16.704085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.715067 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cf2f5-a63e-4c87-a8a8-b413f1dc152f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.771450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.772130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.772413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.775442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.775442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.775442 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.887504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1285/2530] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:16 2022] POST /identity/v3/users => generated 310 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:16.891738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70931286-1506-462a-8730-67d7a035070c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.902710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70931286-1506-462a-8730-67d7a035070c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.907372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.908043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.908326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.908604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.909342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.910987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:16.922853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1246/2531] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:16.927173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:16.938363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3974d-c5f1-4154-b236-589dfe5f88fc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:16.946058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:16.946618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:16.946910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:16.947180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] PATH_INFO: `/v3/projects/fe3962a9582b427eab0fe9afad70c12c/users/d69ccab0614d448b9db5baff518f87c5/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:16.963069 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3962a9582b427eab0fe9afad70c12c, user_id=d69ccab0614d448b9db5baff518f87c5, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:16.965716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:17.121513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1286/2532] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:16 2022] PUT /identity/v3/projects/fe3962a9582b427eab0fe9afad70c12c/users/d69ccab0614d448b9db5baff518f87c5/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:17.125526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:17.136175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a473d-07d6-4e47-b64f-56a163a448fb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:17.193202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921bf35-a212-4708-9be9-5466c081d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:17.193852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921bf35-a212-4708-9be9-5466c081d28d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:17.194185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921bf35-a212-4708-9be9-5466c081d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:17.194658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921bf35-a212-4708-9be9-5466c081d28d admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:17.195536 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921bf35-a212-4708-9be9-5466c081d28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:17.197450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921bf35-a212-4708-9be9-5466c081d28d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:17.208033 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1247/2533] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:17.212836 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:17.223305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36209-22c1-44da-9492-c65f69016ff5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:17.229115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:17.230006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:17.230359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:17.237592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] PATH_INFO: `/v3/projects/fe3962a9582b427eab0fe9afad70c12c/users/d69ccab0614d448b9db5baff518f87c5/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:17.237592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3962a9582b427eab0fe9afad70c12c, user_id=d69ccab0614d448b9db5baff518f87c5, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:17.237592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:17.246478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1287/2534] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:17 2022] PUT /identity/v3/projects/fe3962a9582b427eab0fe9afad70c12c/users/d69ccab0614d448b9db5baff518f87c5/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:17.258795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:17.259094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:17.259378 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:17.287692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] MFA Rules not processed for user `d69ccab0614d448b9db5baff518f87c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:17.289633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:17.357990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1248/2535] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:17.369222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:17.370940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:17.429522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75d8d-cd32-427c-97c5-81bad8de83c0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:17.433222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:17.433874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:17.434185 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:17.434464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:17.444060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:17.445697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:17.455228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1288/2536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:17.814832 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:17.816377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:17.837119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:17.845560 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312f815-2c70-4084-b62d-bb91516251c0 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:17.849440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f085b6-9844-439f-bc6c-6228df8174df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:17.850082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f085b6-9844-439f-bc6c-6228df8174df service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:17.850396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f085b6-9844-439f-bc6c-6228df8174df service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:17.850798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f085b6-9844-439f-bc6c-6228df8174df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:17.885483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51d2bf-9dda-40b4-8901-448aa8de67c7 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:17.890176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:17.891064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:17.891346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:17.891617 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] PATH_INFO: `/v3/users/085189bd517d4b43abe0168732e61cb9` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:17.892834 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=085189bd517d4b43abe0168732e61cb9)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:17.894824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:17.909919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f085b6-9844-439f-bc6c-6228df8174df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:17.911310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f085b6-9844-439f-bc6c-6228df8174df service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:17.921400 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1289/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:18.077110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085189bd517d4b43abe0168732e61cb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:18.077776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085189bd517d4b43abe0168732e61cb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:18.084646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085189bd517d4b43abe0168732e61cb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:18.097679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085189bd517d4b43abe0168732e61cb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:18.098671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085189bd517d4b43abe0168732e61cb9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:18.218227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1249/2538] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:17 2022] DELETE /identity/v3/users/085189bd517d4b43abe0168732e61cb9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:18.223199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:18.223489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:18.223774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:18.241226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:18.245628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:18.310532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1290/2539] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:18.323394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:18.324866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:18.386538 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f655-77fb-4a6c-b00c-18c02ae831fb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:18.390686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:18.391342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:18.391627 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:18.391904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:18.402505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:18.404008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:18.415314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1250/2540] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:18.933366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:18.935255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:18.948636 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32185f36-a765-4faa-b2e3-5b61b1ac782e None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:18.955981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:18.956868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:18.957151 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:18.957427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] PATH_INFO: `/v3/projects/552390484855498ea9bb8450db6c3864` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:18.958724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=552390484855498ea9bb8450db6c3864)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:18.961967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:19.090326 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552390484855498ea9bb8450db6c3864', 'request_id': 'req-4c73de7e-6410-439f-9e15-6be4a47d21cd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.096542 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552390484855498ea9bb8450db6c3864', 'request_id': 'req-4c73de7e-6410-439f-9e15-6be4a47d21cd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.165841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552390484855498ea9bb8450db6c3864', 'request_id': 'req-4c73de7e-6410-439f-9e15-6be4a47d21cd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.177528 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] The token cache is being invalidate because project 552390484855498ea9bb8450db6c3864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:19.177818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.178484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.180146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1291/2541] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:18 2022] DELETE /identity/v3/projects/552390484855498ea9bb8450db6c3864 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:19.184181 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:19.194044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720659c8-188e-4e04-a464-8b408a68a6e8 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:19.252662 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:19.253614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:19.263554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:19.263554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] PATH_INFO: `/v3/users/0c2fc9e075664748b72f0d65e9b23c35` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:19.263554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2fc9e075664748b72f0d65e9b23c35)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:19.263554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:19.545277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2fc9e075664748b72f0d65e9b23c35'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.545942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2fc9e075664748b72f0d65e9b23c35'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.552621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2fc9e075664748b72f0d65e9b23c35'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.564404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2fc9e075664748b72f0d65e9b23c35'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.565141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-7255c3da-6e08-42f1-bed2-a1387b838a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2fc9e075664748b72f0d65e9b23c35'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:19.729814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1251/2542] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:19 2022] DELETE /identity/v3/users/0c2fc9e075664748b72f0d65e9b23c35 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:20.143332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.153853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:20.158264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73de7e-6410-439f-9e15-6be4a47d21cd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:20.228719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:20.228895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.229310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.229501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] PATH_INFO: `/v3/projects/3153e07b8d5b4297bd61a9d5dff5adeb` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.231154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3153e07b8d5b4297bd61a9d5dff5adeb)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:20.234203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:20.348213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3153e07b8d5b4297bd61a9d5dff5adeb', 'request_id': 'req-2cc18f7e-478b-4a32-b35e-f8925e19d04d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:20.354157 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3153e07b8d5b4297bd61a9d5dff5adeb', 'request_id': 'req-2cc18f7e-478b-4a32-b35e-f8925e19d04d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:20.438664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3153e07b8d5b4297bd61a9d5dff5adeb', 'request_id': 'req-2cc18f7e-478b-4a32-b35e-f8925e19d04d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:20.449954 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] The token cache is being invalidate because project 3153e07b8d5b4297bd61a9d5dff5adeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:20.450277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:20.451021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-2cc18f7e-478b-4a32-b35e-f8925e19d04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:20.452594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1292/2543] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:20 2022] DELETE /identity/v3/projects/3153e07b8d5b4297bd61a9d5dff5adeb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:20.457944 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.458429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.458583 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.477760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:20.479046 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:20.538279 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1252/2544] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:20.546694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.547064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.547351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.565865 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:20.567213 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:20.575725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1293/2545] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:20.579976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.589898 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e95a5-a8bf-4a46-a692-75a64e970d71 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:20.594490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:20.595137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.595414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.595682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.596400 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:20.596700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:20.598306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:20.610305 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1253/2546] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:25:20.614501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.623598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511288ff-30d1-4c6e-9697-bf2ee6501797 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:20.628268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:20.628906 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.629187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.629712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.630424 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:20.632924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:20.755655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1294/2547] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:20 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:20.760262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.770024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd081394-fc2b-4d22-80fe-f24c526c6ab1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:20.826029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:20.826730 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.827015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.827318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.828003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:20.829938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:20.919016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1254/2548] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:20 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:20.922881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.933177 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e133b36-182d-438f-b91b-884da6314966 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:20.937945 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:20.938634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.938916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.939212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.939947 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:20.941561 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:20.952375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1295/2549] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:20.956129 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.966706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a170-1bcd-45e4-b3d7-0c7061a9dd7f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:20.971297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb79e4-beab-4b95-8817-c43cb0e82542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:20.971950 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb79e4-beab-4b95-8817-c43cb0e82542 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:20.972234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb79e4-beab-4b95-8817-c43cb0e82542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:20.972515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb79e4-beab-4b95-8817-c43cb0e82542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:20.973243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb79e4-beab-4b95-8817-c43cb0e82542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:20.974855 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb79e4-beab-4b95-8817-c43cb0e82542 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:20.984655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1255/2550] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:20.989120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:20.999519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827345b-8a02-4513-97c5-535afceb0be9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.004136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.005263 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.005544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.005872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] PATH_INFO: `/v3/projects/1016e2e4b457416c98a227164c79439c/users/fe49b411323245b29b1d0ff0f813e2bd/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.021815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1016e2e4b457416c98a227164c79439c, user_id=fe49b411323245b29b1d0ff0f813e2bd, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.024744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.108633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1296/2551] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:20 2022] PUT /identity/v3/projects/1016e2e4b457416c98a227164c79439c/users/fe49b411323245b29b1d0ff0f813e2bd/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:21.126654 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.126946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.127227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.153544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] MFA Rules not processed for user `fe49b411323245b29b1d0ff0f813e2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:21.154770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:21.216782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1256/2552] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:21.221252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.281976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49693e-8919-41a3-9159-b519d5d75c37 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.286752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.287409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.287686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.287960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.288650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.290642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.413043 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1297/2553] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:21 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:21.418375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.429429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb08b-2d83-46ad-a2ab-7a2f63f8824e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.484781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.485464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.485727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.486008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.486738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.488691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.583130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1257/2554] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:21 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:21.587353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.597599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9980-58f3-4bd0-9b1a-a4852d1278e0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.602872 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.603562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.603840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.604110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.604841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.606411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.616592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1298/2555] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:21.621338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.631521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14b7f-7a0c-4ff7-876b-5ede008e6424 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.636355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.637225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.637505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.637814 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] PATH_INFO: `/v3/projects/859c1afff3f44f38bc3e897ad08d0f96/users/df532449d3184f538d4f7b05da90b659/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.652273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859c1afff3f44f38bc3e897ad08d0f96, user_id=df532449d3184f538d4f7b05da90b659, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.655021 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.719271 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1258/2556] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:21 2022] PUT /identity/v3/projects/859c1afff3f44f38bc3e897ad08d0f96/users/df532449d3184f538d4f7b05da90b659/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:21.723219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.734267 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe83d-28b2-43a9-8e0d-6f4897bfed2e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.791628 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c5376-bc29-4c13-92a5-56fe35c330eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.792673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c5376-bc29-4c13-92a5-56fe35c330eb admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.793170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c5376-bc29-4c13-92a5-56fe35c330eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.793668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c5376-bc29-4c13-92a5-56fe35c330eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.794867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c5376-bc29-4c13-92a5-56fe35c330eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.796451 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c5376-bc29-4c13-92a5-56fe35c330eb admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.807357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1299/2557] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:21.811543 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.821873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6084-1963-4801-b8ad-5537b981e6d8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:21.826610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:21.827487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.827768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.828072 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] PATH_INFO: `/v3/projects/859c1afff3f44f38bc3e897ad08d0f96/users/df532449d3184f538d4f7b05da90b659/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.830054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=859c1afff3f44f38bc3e897ad08d0f96, user_id=df532449d3184f538d4f7b05da90b659, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:21.832815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:21.843601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1259/2558] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:21 2022] PUT /identity/v3/projects/859c1afff3f44f38bc3e897ad08d0f96/users/df532449d3184f538d4f7b05da90b659/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:21.853928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:21.854252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:21.854533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:21.879884 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] MFA Rules not processed for user `df532449d3184f538d4f7b05da90b659`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:21.881068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:21.946160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1300/2559] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:21.956993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:21.958755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:22.015422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69d522-1c58-429b-bc4f-f48808eabeaf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:22.019604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382176b-10c5-4172-af85-89285743638f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:22.020244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382176b-10c5-4172-af85-89285743638f service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:22.020523 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382176b-10c5-4172-af85-89285743638f service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:22.020796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382176b-10c5-4172-af85-89285743638f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:22.075901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382176b-10c5-4172-af85-89285743638f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:22.077309 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382176b-10c5-4172-af85-89285743638f service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:22.086373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1260/2560] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:28.461808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:28.473533 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d47bd-d27d-4388-b206-3e8cda14f1b4 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:28.477406 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d80f4-4075-4136-8991-00805f0ae7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:28.478068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d80f4-4075-4136-8991-00805f0ae7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:28.478384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d80f4-4075-4136-8991-00805f0ae7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:28.478657 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d80f4-4075-4136-8991-00805f0ae7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:28.488044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d80f4-4075-4136-8991-00805f0ae7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:28.489459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d80f4-4075-4136-8991-00805f0ae7e3 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:28.501922 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1301/2561] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:30.083976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382176b-10c5-4172-af85-89285743638f service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:30.085390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-6382176b-10c5-4172-af85-89285743638f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:30.148713 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382176b-10c5-4172-af85-89285743638f service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:30.153693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:30.154576 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:30.154850 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:30.155117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] PATH_INFO: `/v3/users/ea4fb8bd9643465087f0415cbb273c38` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:30.156286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4fb8bd9643465087f0415cbb273c38)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:30.158205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:30.425155 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4fb8bd9643465087f0415cbb273c38'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:30.425915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4fb8bd9643465087f0415cbb273c38'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:30.434461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4fb8bd9643465087f0415cbb273c38'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:30.445692 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4fb8bd9643465087f0415cbb273c38'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:30.446370 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4fb8bd9643465087f0415cbb273c38'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:30.518241 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1261/2562] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:30 2022] DELETE /identity/v3/users/ea4fb8bd9643465087f0415cbb273c38 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:30.529899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:30.530438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:30.530545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:30.548141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:30.549398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:30.605018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1302/2563] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:30.614374 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:30.615742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:30.672420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17336-5598-4518-ab62-ec7ca369af5e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:30.675978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:30.676613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:30.676890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:30.677167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:30.686507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:30.687911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:30.697260 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1262/2564] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:31.105793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:31.107252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:31.119841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd57db2-1732-404e-ada2-f99e70d9c3a9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:31.124992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:31.125864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:31.126175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:31.126475 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] PATH_INFO: `/v3/projects/205d030547fc47cc9b9a09829f2e2d74` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:31.127676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205d030547fc47cc9b9a09829f2e2d74)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:31.129871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:31.240859 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205d030547fc47cc9b9a09829f2e2d74', 'request_id': 'req-e206538a-444d-44e4-ba6e-62a8f579dd87'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.247116 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205d030547fc47cc9b9a09829f2e2d74', 'request_id': 'req-e206538a-444d-44e4-ba6e-62a8f579dd87'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.325434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205d030547fc47cc9b9a09829f2e2d74', 'request_id': 'req-e206538a-444d-44e4-ba6e-62a8f579dd87'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.337252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] The token cache is being invalidate because project 205d030547fc47cc9b9a09829f2e2d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:31.337551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.338228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.339818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1303/2565] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:31 2022] DELETE /identity/v3/projects/205d030547fc47cc9b9a09829f2e2d74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:31.343936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:31.354056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679092a-f99a-438e-9b7c-d2ed4f6a52da service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:31.410255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:31.411162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:31.411438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:31.411714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] PATH_INFO: `/v3/users/d69ccab0614d448b9db5baff518f87c5` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:31.412909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69ccab0614d448b9db5baff518f87c5)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:31.414925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:31.613840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69ccab0614d448b9db5baff518f87c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.614503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69ccab0614d448b9db5baff518f87c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.621620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69ccab0614d448b9db5baff518f87c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.640886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69ccab0614d448b9db5baff518f87c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.640886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a86e3058-2e09-45fc-9f30-cafeec3e8c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69ccab0614d448b9db5baff518f87c5'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:31.714720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1263/2566] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:31 2022] DELETE /identity/v3/users/d69ccab0614d448b9db5baff518f87c5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:32.108704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.110164 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:32.126525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206538a-444d-44e4-ba6e-62a8f579dd87 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.182892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.183668 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.183950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.184227 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] PATH_INFO: `/v3/projects/fe3962a9582b427eab0fe9afad70c12c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.185405 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3962a9582b427eab0fe9afad70c12c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.187422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:32.285704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3962a9582b427eab0fe9afad70c12c', 'request_id': 'req-a7599065-7977-4866-a782-ee40c182f115'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:32.291490 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3962a9582b427eab0fe9afad70c12c', 'request_id': 'req-a7599065-7977-4866-a782-ee40c182f115'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:32.348360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3962a9582b427eab0fe9afad70c12c', 'request_id': 'req-a7599065-7977-4866-a782-ee40c182f115'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:32.360085 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] The token cache is being invalidate because project fe3962a9582b427eab0fe9afad70c12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:32.360368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:32.361031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-a7599065-7977-4866-a782-ee40c182f115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:32.362615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1304/2567] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:32 2022] DELETE /identity/v3/projects/fe3962a9582b427eab0fe9afad70c12c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:32.367608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.368089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.368188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.386217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:32.387408 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:32.448833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1264/2568] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:32.456786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.457098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.457383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.477039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:32.478933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:32.487056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1305/2569] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:32.491442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.500969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734189d8-b4fc-4fe7-b2be-01d60ea71e4a None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.505767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.506444 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.506721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.506990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.507714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:32.508017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.509801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:32.520974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1265/2570] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:25:32.525791 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.534997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdedc-1631-4738-a885-f775d36a9bea None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.539763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.540420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.540788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.541044 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.542466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.544395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:32.628908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1306/2571] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:32 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:32.633714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.644390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04a4a8-b6f5-485d-a25b-cb0b28b370ca admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.698493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.699207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.699467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.699770 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.700551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.702501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:32.805643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1266/2572] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:32 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:32.810055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.820394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a33c4-755e-4981-aed0-ae65a8919811 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.825986 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.826676 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.827119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.827359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.828091 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.829720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:32.842200 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1307/2573] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:32.846237 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.856671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec55a06-1c8e-4267-9cd6-30c3e2f2ad72 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.861188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee531d64-da6b-430e-9061-bf2084e71be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.863655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531d64-da6b-430e-9061-bf2084e71be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.863655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531d64-da6b-430e-9061-bf2084e71be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.863655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531d64-da6b-430e-9061-bf2084e71be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.863655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee531d64-da6b-430e-9061-bf2084e71be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.864690 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee531d64-da6b-430e-9061-bf2084e71be4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:32.875781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1267/2574] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:32.880364 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:32.890261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85bba-a89d-4d2d-8edd-366f33dd246f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:32.895111 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:32.895971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:32.901939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:32.901939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] PATH_INFO: `/v3/projects/d6ef13354acd4cf8bdf81ac59a585014/users/984c9b7974c14c4598e308f36ac1cd4c/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:32.916747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ef13354acd4cf8bdf81ac59a585014, user_id=984c9b7974c14c4598e308f36ac1cd4c, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:32.919422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.034671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1308/2575] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:32 2022] PUT /identity/v3/projects/d6ef13354acd4cf8bdf81ac59a585014/users/984c9b7974c14c4598e308f36ac1cd4c/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:33.046688 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.046975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.047251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.073090 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] MFA Rules not processed for user `984c9b7974c14c4598e308f36ac1cd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:33.074307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:33.137392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1268/2576] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:33.142014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.202876 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbb618-d871-424a-a944-db254d48d134 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.207598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.208285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.208582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.208844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.209567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.211466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.322436 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1309/2577] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:33 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:33.326450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.337352 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ba0d4-0b94-4e9a-b379-adab3c895623 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.393793 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.394509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.394792 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.395066 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.395771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.397689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.491575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1269/2578] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:33 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:33.495660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.506566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a390317-195e-454c-b502-286efde5b34f admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.511733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.512394 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.512677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.512997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.513683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.515367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.526383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1310/2579] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:33.532425 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.542372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ccc02-95e3-407d-a8ac-f2f44b9e53e8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.546954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.547880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.548158 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.548430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] PATH_INFO: `/v3/projects/97b880783eb94e5fb9848e52f7a9e98c/users/75173db7aeef46339fb154c80445f1e5/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.564775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b880783eb94e5fb9848e52f7a9e98c, user_id=75173db7aeef46339fb154c80445f1e5, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.567475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.640779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1270/2580] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:33 2022] PUT /identity/v3/projects/97b880783eb94e5fb9848e52f7a9e98c/users/75173db7aeef46339fb154c80445f1e5/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:33.644856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.655150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221ce3d-5203-4808-be34-3e7f37c462e0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.710543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04acd2-b841-4f26-8b2c-8088610f778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.711281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04acd2-b841-4f26-8b2c-8088610f778e admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.711634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04acd2-b841-4f26-8b2c-8088610f778e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.712035 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04acd2-b841-4f26-8b2c-8088610f778e admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.713622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04acd2-b841-4f26-8b2c-8088610f778e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.715071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04acd2-b841-4f26-8b2c-8088610f778e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.724995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1311/2581] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:33.730961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.739478 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f869bd-61af-48a7-b225-ab373f48eb92 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.744635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.745503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.745776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.746044 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] PATH_INFO: `/v3/projects/97b880783eb94e5fb9848e52f7a9e98c/users/75173db7aeef46339fb154c80445f1e5/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.748027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b880783eb94e5fb9848e52f7a9e98c, user_id=75173db7aeef46339fb154c80445f1e5, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.750679 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.762643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1271/2582] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:33 2022] PUT /identity/v3/projects/97b880783eb94e5fb9848e52f7a9e98c/users/75173db7aeef46339fb154c80445f1e5/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:33.771551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.771839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.772123 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.797939 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] MFA Rules not processed for user `75173db7aeef46339fb154c80445f1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:33.799238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:33.864708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1312/2583] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:33.876525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:33.878234 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:33.934749 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b59f-11ca-49fc-82dd-11451bd169ed admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:33.938372 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7313-e3d4-4365-ada8-b924c7d85814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:33.939008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7313-e3d4-4365-ada8-b924c7d85814 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:33.939289 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7313-e3d4-4365-ada8-b924c7d85814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:33.939563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7313-e3d4-4365-ada8-b924c7d85814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:33.949311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7313-e3d4-4365-ada8-b924c7d85814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:33.950801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7313-e3d4-4365-ada8-b924c7d85814 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:33.965411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1272/2584] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:35.122099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:35.184398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072f0f7-476d-4c04-b401-18a73f4f44d9 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:35.189313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:35.190214 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:35.190496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:35.190773 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] PATH_INFO: `/v3/users/984c9b7974c14c4598e308f36ac1cd4c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:35.192068 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984c9b7974c14c4598e308f36ac1cd4c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:35.193975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:35.464479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984c9b7974c14c4598e308f36ac1cd4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:35.565736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984c9b7974c14c4598e308f36ac1cd4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:35.576742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984c9b7974c14c4598e308f36ac1cd4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:35.590206 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984c9b7974c14c4598e308f36ac1cd4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:35.590932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984c9b7974c14c4598e308f36ac1cd4c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:35.596846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1313/2585] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:35 2022] DELETE /identity/v3/users/984c9b7974c14c4598e308f36ac1cd4c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:35.601512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:35.601970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:35.602094 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:35.623936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:35.625124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:35.684025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1273/2586] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:35.693611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:35.695207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:35.751305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c06a5-3596-4c62-996f-576becb59d19 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:35.755205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:35.758534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:35.758534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:35.758534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:35.767375 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:35.768801 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:35.778170 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1314/2587] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:25:36.195562 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:36.197078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:36.209604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc60d1-59a9-40fa-8b31-a260404d6d26 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:36.215175 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:36.216432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:36.216432 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:36.216668 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] PATH_INFO: `/v3/projects/d6ef13354acd4cf8bdf81ac59a585014` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:36.217968 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ef13354acd4cf8bdf81ac59a585014)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:36.220456 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:36.318012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ef13354acd4cf8bdf81ac59a585014', 'request_id': 'req-da4b0049-c56e-423a-97fa-ca80a87510f9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.323864 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ef13354acd4cf8bdf81ac59a585014', 'request_id': 'req-da4b0049-c56e-423a-97fa-ca80a87510f9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.405883 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ef13354acd4cf8bdf81ac59a585014', 'request_id': 'req-da4b0049-c56e-423a-97fa-ca80a87510f9'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.417165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] The token cache is being invalidate because project d6ef13354acd4cf8bdf81ac59a585014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:36.417451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.418071 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.419637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1274/2588] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:36 2022] DELETE /identity/v3/projects/d6ef13354acd4cf8bdf81ac59a585014 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:36.423616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:36.433047 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff57f-d0a6-4b6f-af73-e4f95e2c92c4 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:36.487815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:36.488683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:36.488958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:36.489228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] PATH_INFO: `/v3/users/75173db7aeef46339fb154c80445f1e5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:36.490440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=75173db7aeef46339fb154c80445f1e5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:36.492323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:36.681388 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75173db7aeef46339fb154c80445f1e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.759596 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75173db7aeef46339fb154c80445f1e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.767959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75173db7aeef46339fb154c80445f1e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.780030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75173db7aeef46339fb154c80445f1e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.780701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-767ee424-8578-4bb8-9876-2e779836ddfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75173db7aeef46339fb154c80445f1e5'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:36.786626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1315/2589] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:36 2022] DELETE /identity/v3/users/75173db7aeef46339fb154c80445f1e5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:37.173947 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:37.175498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:37.189460 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0049-c56e-423a-97fa-ca80a87510f9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:37.248048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:37.248869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:37.249149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:37.249420 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] PATH_INFO: `/v3/projects/97b880783eb94e5fb9848e52f7a9e98c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:37.250620 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b880783eb94e5fb9848e52f7a9e98c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:37.252499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:37.375426 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b880783eb94e5fb9848e52f7a9e98c', 'request_id': 'req-5e4fb13e-3906-4011-b99a-4df7cb7807e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:37.381424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b880783eb94e5fb9848e52f7a9e98c', 'request_id': 'req-5e4fb13e-3906-4011-b99a-4df7cb7807e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:37.570481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b880783eb94e5fb9848e52f7a9e98c', 'request_id': 'req-5e4fb13e-3906-4011-b99a-4df7cb7807e0'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:37.582354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] The token cache is being invalidate because project 97b880783eb94e5fb9848e52f7a9e98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:37.582641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:37.583267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-5e4fb13e-3906-4011-b99a-4df7cb7807e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:37.584795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1275/2590] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:37 2022] DELETE /identity/v3/projects/97b880783eb94e5fb9848e52f7a9e98c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:37.590992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:37.597432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:37.597432 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:37.612249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:37.613445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:37.671310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1316/2591] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:37.679060 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:37.679350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:37.679622 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:37.697326 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:37.698694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:37.706848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1276/2592] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:37.711145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:37.721107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae915-6b9c-47d4-85aa-cfe37e71cc20 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:37.725567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:37.726240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:37.726519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:37.726788 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:37.727519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:37.727822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:37.729970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:37.741726 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1317/2593] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:25:37.746338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:37.755540 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5227c9-9f83-4393-bef3-342f337a00a6 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:37.760106 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:37.760897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:37.761171 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:37.761445 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:37.762161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:37.764074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:37.880925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1277/2594] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:37 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:37.885048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:37.895006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b708490-f193-45df-be60-5d78ca439a36 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:37.948724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:37.949308 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:37.949591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:37.949868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:37.950611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:37.952553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:38.022515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1318/2595] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:37 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:38.026904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:38.036909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c892-6a3d-43d9-a37d-587e764b4271 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:38.041553 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:38.042739 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:38.043159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:38.043453 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:38.044168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:38.045758 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:38.055836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1278/2596] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:38.060707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:38.070448 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1ba6b-5df0-4d75-a345-789a6cfd4231 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:38.075158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e4829-eec8-40c3-b4d1-6e11e3892bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:38.075808 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4829-eec8-40c3-b4d1-6e11e3892bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:38.076082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4829-eec8-40c3-b4d1-6e11e3892bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:38.076353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4829-eec8-40c3-b4d1-6e11e3892bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:38.077070 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e4829-eec8-40c3-b4d1-6e11e3892bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:38.078679 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e4829-eec8-40c3-b4d1-6e11e3892bfa admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:38.088142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1319/2597] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:38.092227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:38.102022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7f3c-c86c-4ffb-9b5c-64b1ccbe2c73 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:38.107473 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:38.108350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:38.108632 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:38.108907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] PATH_INFO: `/v3/projects/1c4157d187914c61a8adc64930617362/users/40c9a3c62a644c10ab78aaf9ef1da760/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:38.123766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4157d187914c61a8adc64930617362, user_id=40c9a3c62a644c10ab78aaf9ef1da760, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:38.126516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:38.234982 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1279/2598] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:38 2022] PUT /identity/v3/projects/1c4157d187914c61a8adc64930617362/users/40c9a3c62a644c10ab78aaf9ef1da760/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:38.246292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:38.246580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:38.246881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:38.272797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] MFA Rules not processed for user `40c9a3c62a644c10ab78aaf9ef1da760`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:38.273991 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:38.336647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1320/2599] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:38.348266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:38.350008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:38.408846 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd849a-c22a-45a2-9192-8465782f4383 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:38.412524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042ef69-4fd7-497a-9747-cb9940d3ff2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:38.413167 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042ef69-4fd7-497a-9747-cb9940d3ff2d service glance] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:38.413446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042ef69-4fd7-497a-9747-cb9940d3ff2d service glance] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:38.413720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042ef69-4fd7-497a-9747-cb9940d3ff2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:38.422879 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042ef69-4fd7-497a-9747-cb9940d3ff2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:38.424311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042ef69-4fd7-497a-9747-cb9940d3ff2d service glance] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:38.433274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1280/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:55.924557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:55.925967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:55.993465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fbe35-523e-4f43-a9ac-e086c12373a8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:55.998148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:55.998935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:55.999211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:55.999489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] PATH_INFO: `/v3/users/fe49b411323245b29b1d0ff0f813e2bd` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:56.001345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe49b411323245b29b1d0ff0f813e2bd)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:56.003372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:56.139762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe49b411323245b29b1d0ff0f813e2bd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:56.200007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe49b411323245b29b1d0ff0f813e2bd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:56.207645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe49b411323245b29b1d0ff0f813e2bd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:56.221723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe49b411323245b29b1d0ff0f813e2bd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:56.221723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe49b411323245b29b1d0ff0f813e2bd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:56.226183 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1321/2601] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:55 2022] DELETE /identity/v3/users/fe49b411323245b29b1d0ff0f813e2bd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:56.230673 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:56.231151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:56.231259 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:56.249063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:56.250297 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:56.310902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1281/2602] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:56.321255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:56.322683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:56.380932 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4216bbd-4c7c-449a-8504-924dcd6b9647 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:56.388848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:56.389453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:56.389731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:56.390008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:56.400120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:56.401556 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:56.411558 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1322/2603] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:56.812871 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:56.814517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:56.826829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be27bc-b537-4b9b-a529-6be7e44d301e None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:56.832056 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:56.832916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:56.833203 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:56.833482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] PATH_INFO: `/v3/projects/1016e2e4b457416c98a227164c79439c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:56.834705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1016e2e4b457416c98a227164c79439c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:56.836611 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:56.970990 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1016e2e4b457416c98a227164c79439c', 'request_id': 'req-331ce5ca-ee5f-4064-92bd-224dde517959'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:56.976267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1016e2e4b457416c98a227164c79439c', 'request_id': 'req-331ce5ca-ee5f-4064-92bd-224dde517959'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.045671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1016e2e4b457416c98a227164c79439c', 'request_id': 'req-331ce5ca-ee5f-4064-92bd-224dde517959'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.057385 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] The token cache is being invalidate because project 1016e2e4b457416c98a227164c79439c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:57.057585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.058236 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.059784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1282/2604] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:56 2022] DELETE /identity/v3/projects/1016e2e4b457416c98a227164c79439c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:57.064546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:57.073995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e947-f07a-41fb-8b31-ad1913b6c8c6 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:57.130095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:57.131259 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:57.131535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:57.131806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] PATH_INFO: `/v3/users/df532449d3184f538d4f7b05da90b659` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:57.132995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df532449d3184f538d4f7b05da90b659)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:57.134993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:57.374642 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df532449d3184f538d4f7b05da90b659'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.450127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df532449d3184f538d4f7b05da90b659'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.457536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df532449d3184f538d4f7b05da90b659'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.469041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df532449d3184f538d4f7b05da90b659'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.470477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df532449d3184f538d4f7b05da90b659'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.476842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1323/2605] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:57 2022] DELETE /identity/v3/users/df532449d3184f538d4f7b05da90b659 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:57.694362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:57.696401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:57.709847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ce5ca-ee5f-4064-92bd-224dde517959 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:57.764565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:57.765433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:57.765714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:57.766535 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] PATH_INFO: `/v3/users/40c9a3c62a644c10ab78aaf9ef1da760` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:57.767935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c9a3c62a644c10ab78aaf9ef1da760)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:57.769840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:57.917056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:57.918760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:57.932024 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609552-a945-4f46-9f36-af323e436a88 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:57.936716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:57.937578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:57.938965 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:57.939302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] PATH_INFO: `/v3/projects/859c1afff3f44f38bc3e897ad08d0f96` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:57.940631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=859c1afff3f44f38bc3e897ad08d0f96)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:57.942678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:57.954975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c9a3c62a644c10ab78aaf9ef1da760'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.955636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c9a3c62a644c10ab78aaf9ef1da760'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.962349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c9a3c62a644c10ab78aaf9ef1da760'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.974085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c9a3c62a644c10ab78aaf9ef1da760'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:57.975261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-851481f1-7703-4f8a-9c1e-41cab488af62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c9a3c62a644c10ab78aaf9ef1da760'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.074751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859c1afff3f44f38bc3e897ad08d0f96', 'request_id': 'req-815f44eb-b71e-464a-b995-0562fcd33b9d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.080781 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859c1afff3f44f38bc3e897ad08d0f96', 'request_id': 'req-815f44eb-b71e-464a-b995-0562fcd33b9d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.102696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1283/2606] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:25:57 2022] DELETE /identity/v3/users/40c9a3c62a644c10ab78aaf9ef1da760 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:58.107149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.107398 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.107684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.125242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:58.127509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.185254 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1284/2607] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:58.195807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.197134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.199811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859c1afff3f44f38bc3e897ad08d0f96', 'request_id': 'req-815f44eb-b71e-464a-b995-0562fcd33b9d'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.212023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] The token cache is being invalidate because project 859c1afff3f44f38bc3e897ad08d0f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:58.212311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.215902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-815f44eb-b71e-464a-b995-0562fcd33b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.215902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1324/2608] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:57 2022] DELETE /identity/v3/projects/859c1afff3f44f38bc3e897ad08d0f96 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:58.220807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48c1b2-37fe-49a5-83b0-74daf6acce1f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.221120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48c1b2-37fe-49a5-83b0-74daf6acce1f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.221434 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48c1b2-37fe-49a5-83b0-74daf6acce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.241167 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6e48c1b2-37fe-49a5-83b0-74daf6acce1f None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:58.242395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6e48c1b2-37fe-49a5-83b0-74daf6acce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.251311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1325/2609] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:58.257015 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702fba1-6bdb-4f23-bf64-bfe5aac81b15 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.260957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.261609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.261894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.262225 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.264103 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.267106 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.267510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.267898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.277684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.279394 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.287565 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:58.293271 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.293443 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1285/2610] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:25:58.297936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1326/2611] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:58.301921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.311682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4e639-dbb7-4e73-a9ef-fb6ba399e7d5 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.316827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.317486 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.317764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.318039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.318935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:58.319239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.320828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.333485 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1286/2612] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:25:58.337984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.356598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7cb49-e568-4f56-ae97-136e75b03aa5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.362783 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.367940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.367940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.367940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.367940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.367940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.477082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1327/2613] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:58.481123 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.491023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a24eb-c80e-440b-bcd8-91b637fd74d5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.548476 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.549159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.549441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.549717 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.551159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.553191 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.652396 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1287/2614] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:58.657198 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.668455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3b6d-e14e-4b15-aea1-a186d2b2d807 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.673575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.675039 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.675331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.675614 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.676420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.678089 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.689469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1328/2615] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:58.693513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.704545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc090-84bc-4d9d-9acf-02d4f7852b73 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.709429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.710097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.718052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.718052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.718052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.718052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.723763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1288/2616] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:58.728118 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.738347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39be29-557e-416e-a558-a2ed7ec76b03 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.743092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5fe2a-a58e-4a60-b55a-2a1ddc81a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.743967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5fe2a-a58e-4a60-b55a-2a1ddc81a304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.744248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5fe2a-a58e-4a60-b55a-2a1ddc81a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.744525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5fe2a-a58e-4a60-b55a-2a1ddc81a304 admin admin] PATH_INFO: `/v3/projects/8f0f954e163646a49d018ae57d595cc5/users/22b44c9f2ed64e50ad3c678cc65791c7/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.759710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5fe2a-a58e-4a60-b55a-2a1ddc81a304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0f954e163646a49d018ae57d595cc5, user_id=22b44c9f2ed64e50ad3c678cc65791c7, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.762370 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5fe2a-a58e-4a60-b55a-2a1ddc81a304 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.778698 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.780437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.795005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290e445-36cc-4b6e-ba70-81726330b718 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:58.800875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:58.801516 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.801725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.802006 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] PATH_INFO: `/v3/projects/1c4157d187914c61a8adc64930617362` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.803517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4157d187914c61a8adc64930617362)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:58.805565 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:58.846280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1329/2617] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:58 2022] PUT /identity/v3/projects/8f0f954e163646a49d018ae57d595cc5/users/22b44c9f2ed64e50ad3c678cc65791c7/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:58.856618 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:58.856907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:58.857208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:58.888379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] MFA Rules not processed for user `22b44c9f2ed64e50ad3c678cc65791c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:58.889589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:58.953526 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1330/2618] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:58.956524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4157d187914c61a8adc64930617362', 'request_id': 'req-267c2e0c-ccbb-487b-84cc-410c6256a48e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:58.958225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:58.968419 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4157d187914c61a8adc64930617362', 'request_id': 'req-267c2e0c-ccbb-487b-84cc-410c6256a48e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:59.022621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e367-fcad-4426-b7af-1aa472fcd5e5 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.052178 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4157d187914c61a8adc64930617362', 'request_id': 'req-267c2e0c-ccbb-487b-84cc-410c6256a48e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:59.065139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] The token cache is being invalidate because project 1c4157d187914c61a8adc64930617362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:25:59.068778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:59.068778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-267c2e0c-ccbb-487b-84cc-410c6256a48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:25:59.068778 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1289/2619] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:25:58 2022] DELETE /identity/v3/projects/1c4157d187914c61a8adc64930617362 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:59.073265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079619-2394-4850-94d7-69bc83d147a7 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.073618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079619-2394-4850-94d7-69bc83d147a7 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.073973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079619-2394-4850-94d7-69bc83d147a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.087280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.088331 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.088806 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.089244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.090484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.093341 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.098594 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-26079619-2394-4850-94d7-69bc83d147a7 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:59.099640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-26079619-2394-4850-94d7-69bc83d147a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:59.109821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1290/2620] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:25:59.117696 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.120291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.120291 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.136735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:59.137920 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:59.146389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1291/2621] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:59.150382 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.159986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97401b5-a9cd-4ee7-b50d-e70a47483990 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.165635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.166484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.166766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.167039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.167768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:25:59.168068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.171842 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1331/2622] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:58 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:59.171997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.172826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.174507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:59.185114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1292/2623] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:25:59.186064 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.195646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b024a7-9dba-47a6-b8c0-f2081a65e2ab admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.235831 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cca3e-c22a-4b25-b2b9-bd3f01cd9612 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.240707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.241626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.241914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.242222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.243074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.244982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.253630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.254312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.254597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.254863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.255830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.257720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.383909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1332/2624] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:25:59.388427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.399142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391f0c3-77aa-4221-89b2-e9e8eef06fd5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.404176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.404849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.411603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.411603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.411603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.411603 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.416229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1293/2625] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:59.421017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.425698 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1333/2626] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:25:59.426936 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.439302 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3a14-df49-4890-99df-b84e5b17c956 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.503023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219b970-fea3-4d91-8d31-7ca850b33065 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.509720 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.510921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.511358 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.511639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.512344 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.514304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.515334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.516471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.516758 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.517696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] PATH_INFO: `/v3/projects/ec3d0ffe679e484dad0ddac7e94f92e5/users/a75ff0e1c08c447895071084212feb51/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.535575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3d0ffe679e484dad0ddac7e94f92e5, user_id=a75ff0e1c08c447895071084212feb51, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.538567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.599011 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1294/2627] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:25:59.602924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.612526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1ec9-eef3-4cdb-92f0-eb4fdca139ba admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.617325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.617970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.618281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.618557 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.619281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.620922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.631886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1295/2628] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:59.635916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.646187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a211a9-9431-465a-a758-ed88e80e4946 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.650710 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.651404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.651686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.651963 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.652728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.654267 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.658995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1334/2629] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:59 2022] PUT /identity/v3/projects/ec3d0ffe679e484dad0ddac7e94f92e5/users/a75ff0e1c08c447895071084212feb51/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:59.666240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.668043 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1296/2630] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:59.668860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.678597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881cee9-5985-4aa3-b49f-94842f09c8c4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.726468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf242-4fc9-4509-a6cb-7f74350105da admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.731601 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.732072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.732351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.732623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.733347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.734504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ca8eb-2fc8-459e-a7ad-7ab471b7a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.734983 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.735584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca8eb-2fc8-459e-a7ad-7ab471b7a266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.736005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca8eb-2fc8-459e-a7ad-7ab471b7a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.736292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca8eb-2fc8-459e-a7ad-7ab471b7a266 admin admin] PATH_INFO: `/v3/projects/73c6299d62734ef9892fbfe9a7fa7a13/users/389916e4dd754cc4b093c1face0a8c76/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.745156 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1335/2631] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:25:59.749244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.752402 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ca8eb-2fc8-459e-a7ad-7ab471b7a266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c6299d62734ef9892fbfe9a7fa7a13, user_id=389916e4dd754cc4b093c1face0a8c76, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.755095 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ca8eb-2fc8-459e-a7ad-7ab471b7a266 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.759696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c72389-efba-46e8-a061-f9a5b7619ad2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.764398 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e195eb1-e627-494f-b3e8-eb4702badb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:25:59.765291 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195eb1-e627-494f-b3e8-eb4702badb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.765625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195eb1-e627-494f-b3e8-eb4702badb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.765905 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195eb1-e627-494f-b3e8-eb4702badb1b admin admin] PATH_INFO: `/v3/projects/ec3d0ffe679e484dad0ddac7e94f92e5/users/a75ff0e1c08c447895071084212feb51/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.772092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e195eb1-e627-494f-b3e8-eb4702badb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3d0ffe679e484dad0ddac7e94f92e5, user_id=a75ff0e1c08c447895071084212feb51, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:25:59.772092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e195eb1-e627-494f-b3e8-eb4702badb1b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:25:59.781599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1336/2632] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:59 2022] PUT /identity/v3/projects/ec3d0ffe679e484dad0ddac7e94f92e5/users/a75ff0e1c08c447895071084212feb51/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:25:59.792592 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.792963 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.793186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.820219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] MFA Rules not processed for user `a75ff0e1c08c447895071084212feb51`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:59.821408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:59.845619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1297/2633] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:25:59 2022] PUT /identity/v3/projects/73c6299d62734ef9892fbfe9a7fa7a13/users/389916e4dd754cc4b093c1face0a8c76/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:25:59.856063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:25:59.856348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:25:59.856625 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:25:59.883511 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] MFA Rules not processed for user `389916e4dd754cc4b093c1face0a8c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:25:59.884723 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:59.889715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1337/2634] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:59.901175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.902616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:25:59.954742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1298/2635] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:25:59.964515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbde67b-36df-4490-b7c2-0a2458b9b07a None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:25:59.966159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:25:59.967500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:00.018236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab11c-adba-4e56-b18d-6cd485c63765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:00.018892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab11c-adba-4e56-b18d-6cd485c63765 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:00.019172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab11c-adba-4e56-b18d-6cd485c63765 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:00.019447 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab11c-adba-4e56-b18d-6cd485c63765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:00.028207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45a5f9-8028-449e-ae8b-ee5b259ca45b None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:00.032038 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:00.032775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:00.033058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:00.033333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:00.041812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:00.043886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:00.056116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1299/2636] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:00.079944 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab11c-adba-4e56-b18d-6cd485c63765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:00.081359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab11c-adba-4e56-b18d-6cd485c63765 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:00.090889 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1338/2637] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:00.616992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:00.688994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea853-f801-461d-8ff1-52a4cfc6c9a8 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:00.693559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:00.694487 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:00.694790 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:00.695062 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] PATH_INFO: `/v3/users/22b44c9f2ed64e50ad3c678cc65791c7` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:00.696294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b44c9f2ed64e50ad3c678cc65791c7)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:00.698156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:00.962467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b44c9f2ed64e50ad3c678cc65791c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:00.963328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b44c9f2ed64e50ad3c678cc65791c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:00.971640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b44c9f2ed64e50ad3c678cc65791c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:00.983243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b44c9f2ed64e50ad3c678cc65791c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:00.983930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b44c9f2ed64e50ad3c678cc65791c7'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:01.091605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1300/2638] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:26:00 2022] DELETE /identity/v3/users/22b44c9f2ed64e50ad3c678cc65791c7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:01.096844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:01.097332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:01.097450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:01.114230 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:01.115427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:01.175495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1339/2639] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:01.185264 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:01.186761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:01.242882 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f661-5b45-4ab3-9a05-95394cde0d70 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:01.246414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:01.247185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:01.247498 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:01.247777 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:01.257740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:01.259221 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:01.269115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1301/2640] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:01.694122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:01.695514 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:01.708257 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84f364-4ffd-4105-bc4f-87fa1d579d16 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:01.713695 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:01.714952 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:01.715445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:01.715874 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] PATH_INFO: `/v3/projects/8f0f954e163646a49d018ae57d595cc5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:01.717508 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0f954e163646a49d018ae57d595cc5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:01.720383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:01.843534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0f954e163646a49d018ae57d595cc5', 'request_id': 'req-315d19d0-7659-491a-9130-d5514344adbc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:01.849663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0f954e163646a49d018ae57d595cc5', 'request_id': 'req-315d19d0-7659-491a-9130-d5514344adbc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:01.908789 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0f954e163646a49d018ae57d595cc5', 'request_id': 'req-315d19d0-7659-491a-9130-d5514344adbc'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:01.920346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] The token cache is being invalidate because project 8f0f954e163646a49d018ae57d595cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:26:01.920659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:01.921338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:01.922978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1340/2641] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:26:01 2022] DELETE /identity/v3/projects/8f0f954e163646a49d018ae57d595cc5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:01.926996 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:01.936465 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f57fbe-63e7-46db-8b9b-d68190ab6201 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:01.993257 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:01.994133 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:01.994423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:01.994702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] PATH_INFO: `/v3/users/a75ff0e1c08c447895071084212feb51` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:01.995897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75ff0e1c08c447895071084212feb51)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:01.997803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:02.223823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75ff0e1c08c447895071084212feb51'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:02.224483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75ff0e1c08c447895071084212feb51'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:02.231135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75ff0e1c08c447895071084212feb51'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:02.243729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75ff0e1c08c447895071084212feb51'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:02.244435 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-582984e6-8574-4e77-abba-2ae025d8d5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75ff0e1c08c447895071084212feb51'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:02.367138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1302/2642] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:26:01 2022] DELETE /identity/v3/users/a75ff0e1c08c447895071084212feb51 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:02.807536 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:02.808984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:02.822852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d19d0-7659-491a-9130-d5514344adbc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:02.878390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:02.879242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:02.879522 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:02.879796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] PATH_INFO: `/v3/projects/ec3d0ffe679e484dad0ddac7e94f92e5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:02.881298 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3d0ffe679e484dad0ddac7e94f92e5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:02.883336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:02.988489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3d0ffe679e484dad0ddac7e94f92e5', 'request_id': 'req-69d7ce41-a0f8-447a-be5e-0b460d2f6820'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:02.993894 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3d0ffe679e484dad0ddac7e94f92e5', 'request_id': 'req-69d7ce41-a0f8-447a-be5e-0b460d2f6820'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:03.072352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3d0ffe679e484dad0ddac7e94f92e5', 'request_id': 'req-69d7ce41-a0f8-447a-be5e-0b460d2f6820'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:03.083812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] The token cache is being invalidate because project ec3d0ffe679e484dad0ddac7e94f92e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:26:03.084096 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:03.084725 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-69d7ce41-a0f8-447a-be5e-0b460d2f6820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:03.086293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1341/2643] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:26:02 2022] DELETE /identity/v3/projects/ec3d0ffe679e484dad0ddac7e94f92e5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:03.092703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.093202 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.093328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.111951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:03.113139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:03.169624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1303/2644] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:03.178203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.178494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.178774 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.197210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:03.198425 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:03.206381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1342/2645] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:03.210555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.220477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1c20-2bc5-473f-9b0f-224ec4593073 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.224995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.225644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.225925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.226233 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.226969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:26:03.227274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.228858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.240515 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1304/2646] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:26:03.244724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.253914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76166e-384c-4db6-8632-0737fcee9e41 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.258823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.259466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.259744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.260019 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.260701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.262687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.373553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1343/2647] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:26:03 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:26:03.377816 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.388209 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627062f-99c2-44da-8e5d-4a676ea02f12 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.443922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.444585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.444894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.445168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.445856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.447986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.513722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1305/2648] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:26:03 2022] POST /identity/v3/users => generated 284 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:26:03.518284 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.528449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30a124-a770-4080-9b26-fb9fd414d2c2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.533941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.534627 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.534903 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.535250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.535980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.537545 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.548856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1344/2649] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:26:03.553026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.563172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd22ba-f27c-4df1-a801-5384d5ade6a9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.567754 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadecd9-1e35-40ba-92de-88239137da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.568405 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadecd9-1e35-40ba-92de-88239137da59 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.568683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadecd9-1e35-40ba-92de-88239137da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.568957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadecd9-1e35-40ba-92de-88239137da59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.569674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadecd9-1e35-40ba-92de-88239137da59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.571733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadecd9-1e35-40ba-92de-88239137da59 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.581552 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1306/2650] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:26:03.585511 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.596160 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0c3fb-471f-4ab8-82a4-eb3ba567de7d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.600654 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.601520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.601794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.602063 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] PATH_INFO: `/v3/projects/067d74efc6f340749b593e01577f9686/users/d8ee03e501cf4453946c2eee7a96877c/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.616175 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067d74efc6f340749b593e01577f9686, user_id=d8ee03e501cf4453946c2eee7a96877c, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.618878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.702793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1345/2651] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:26:03 2022] PUT /identity/v3/projects/067d74efc6f340749b593e01577f9686/users/d8ee03e501cf4453946c2eee7a96877c/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:03.713518 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.713807 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.714126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.741093 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] MFA Rules not processed for user `d8ee03e501cf4453946c2eee7a96877c`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:03.742317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:03.807081 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1307/2652] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:03.818694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:03.820380 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:03.877919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f9ce-d391-412b-97ab-0cb00fbbefe4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:03.881833 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33833cae-3718-42e7-843a-bc0ebb127739 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:03.882506 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33833cae-3718-42e7-843a-bc0ebb127739 service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:03.882784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33833cae-3718-42e7-843a-bc0ebb127739 service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:03.883055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33833cae-3718-42e7-843a-bc0ebb127739 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:03.891863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33833cae-3718-42e7-843a-bc0ebb127739 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:03.893265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33833cae-3718-42e7-843a-bc0ebb127739 service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:03.901751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1346/2653] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:25.398092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:25.399841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:25.463800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5af3-1378-44b6-80cc-96bb8bbbf006 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:25.468497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:25.469290 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:25.469568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:25.469841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] PATH_INFO: `/v3/users/389916e4dd754cc4b093c1face0a8c76` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:25.471067 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=389916e4dd754cc4b093c1face0a8c76)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:25.472976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:25.680343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389916e4dd754cc4b093c1face0a8c76'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:25.680994 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389916e4dd754cc4b093c1face0a8c76'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:25.687618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389916e4dd754cc4b093c1face0a8c76'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:25.698946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389916e4dd754cc4b093c1face0a8c76'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:25.699588 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389916e4dd754cc4b093c1face0a8c76'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:25.782682 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1308/2654] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:26:25 2022] DELETE /identity/v3/users/389916e4dd754cc4b093c1face0a8c76 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:25.787453 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:25.793760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:25.793760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:25.806616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:25.807794 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:25.864973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1347/2655] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:25.875417 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:25.876806 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:25.932865 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd0c8-dbd3-40a6-9f5d-20ad7b706b0b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:25.936481 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf1e2b-5121-4be6-87f6-f4ecd4d05845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:25.937111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1e2b-5121-4be6-87f6-f4ecd4d05845 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:25.937392 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1e2b-5121-4be6-87f6-f4ecd4d05845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:25.937666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1e2b-5121-4be6-87f6-f4ecd4d05845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:25.946922 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf1e2b-5121-4be6-87f6-f4ecd4d05845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:25.948380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf1e2b-5121-4be6-87f6-f4ecd4d05845 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:25.957561 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1309/2656] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:26.373236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:26.375383 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:26.395574 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc302c3-8b39-47f6-97e4-b9d23bc7efe2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:26.407501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:26.408421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:26.408707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:26.409014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] PATH_INFO: `/v3/projects/73c6299d62734ef9892fbfe9a7fa7a13` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:26.410282 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c6299d62734ef9892fbfe9a7fa7a13)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:26.412190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:26.534885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c6299d62734ef9892fbfe9a7fa7a13', 'request_id': 'req-5c867186-a3db-4cd0-a530-9bb352070f8c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:26.540867 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c6299d62734ef9892fbfe9a7fa7a13', 'request_id': 'req-5c867186-a3db-4cd0-a530-9bb352070f8c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:26.609455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c6299d62734ef9892fbfe9a7fa7a13', 'request_id': 'req-5c867186-a3db-4cd0-a530-9bb352070f8c'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:26.622617 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] The token cache is being invalidate because project 73c6299d62734ef9892fbfe9a7fa7a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:26:26.622901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:26.623543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-5c867186-a3db-4cd0-a530-9bb352070f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:26.625202 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1348/2657] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:26:26 2022] DELETE /identity/v3/projects/73c6299d62734ef9892fbfe9a7fa7a13 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:26.630210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:26.630676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:26.631174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:26.649731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:26.650959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:26.709474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1310/2658] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:26.718080 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:26.718399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:26.718674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:26.737498 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:26.738720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:26.747407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1349/2659] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:26.751413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:26.761292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cba6a-53f2-4a21-bd35-8441c56f7f21 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:26.766028 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:26.766718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:26.767003 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:26.767286 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:26.768017 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:26:26.768320 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:26.769939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:26.785858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1311/2660] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:26:26.787162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:26.797377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a22883-7de5-4176-a59f-d69e21318f4c None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:26.802728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:26.803182 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:26.803660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:26.803946 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:26.804736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:26.806637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:26.922006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1350/2661] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:26:26 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:26:26.925815 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:26.936016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3756-12df-4fc7-b43a-9b972ef492ff admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:26.992339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:26.993010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:26.993314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:26.993585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:26.994307 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:26.996204 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:27.140725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1312/2662] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:26:26 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:26:27.144777 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:27.155110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada384bf-746e-4e38-b35f-8fb805ecb221 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:27.160092 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:27.160747 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:27.161023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:27.161292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:27.162018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:27.164281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:27.174832 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1351/2663] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:26:27.179426 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:27.189227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e202c-add3-4583-80c2-2ada2791b052 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:27.195184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493128-439e-477e-b395-322dc29e1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:27.195843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493128-439e-477e-b395-322dc29e1270 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:27.196116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493128-439e-477e-b395-322dc29e1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:27.196389 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493128-439e-477e-b395-322dc29e1270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:27.197105 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493128-439e-477e-b395-322dc29e1270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:27.198727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493128-439e-477e-b395-322dc29e1270 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:27.209108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1313/2664] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:26:27.213362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:27.223072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554db8ec-11a4-453e-8b44-dc7d281a4f10 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:27.228233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:27.229135 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:27.229393 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:27.229667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] PATH_INFO: `/v3/projects/2911e29b2a1c4ae0b0a349dcf665ace3/users/0053f012b7454645867a430706494125/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:27.244837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2911e29b2a1c4ae0b0a349dcf665ace3, user_id=0053f012b7454645867a430706494125, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:27.247485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:27.418377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1352/2665] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:26:27 2022] PUT /identity/v3/projects/2911e29b2a1c4ae0b0a349dcf665ace3/users/0053f012b7454645867a430706494125/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:27.424924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9358357-71d7-4206-922d-87be70d6e6dd None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:27.424924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9358357-71d7-4206-922d-87be70d6e6dd None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:27.424924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9358357-71d7-4206-922d-87be70d6e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:27.442577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-f9358357-71d7-4206-922d-87be70d6e6dd None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:27.443761 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f9358357-71d7-4206-922d-87be70d6e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:27.504709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1314/2666] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:27.514949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:27.516849 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:27.574336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28010aa6-96cb-404e-b51a-e727703ecab2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:27.578094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:27.578770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:27.579056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:27.579336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:27.588913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:27.590461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:27.600815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1353/2667] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:29.410341 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:29.410914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:29.411005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:29.439836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] MFA Rules not processed for user `0053f012b7454645867a430706494125`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:29.441078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:29.535190 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1315/2668] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:29.549966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:29.552274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:29.612854 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0bcc0-f22a-42e3-aabd-06cae6e624b9 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:29.617594 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:29.618293 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:29.618578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:29.618856 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:29.628610 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:29.630090 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:29.640255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1354/2669] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:30.009068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:30.010491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:30.078894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abd25e-fc8d-46c6-b594-fafa41ae0e97 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:30.084606 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:30.085913 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:30.086217 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:30.086494 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:30.088325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:30.104988 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:30.106703 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed51f-70a0-48aa-a752-d173a450847d service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:30.117000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1316/2670] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:31.067310 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:31.078660 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09421e-e0c4-4d4d-935b-45c259a15aac service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:31.082928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:31.083568 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:31.084228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:31.084228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:31.087081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:31.146335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:31.148387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf42e-1dd7-48a6-97dc-2cc83cdc85c6 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:31.160655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1355/2671] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:31.360346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:31.360853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:31.361087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:31.384055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] MFA Rules not processed for user `0053f012b7454645867a430706494125`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:31.387080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:31.456959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1317/2672] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:31.649155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:31.649445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:31.649723 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:31.668531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:31.670017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:31.729855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1356/2673] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:26:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:31.908349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:31.909924 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:31.979663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d62f0-2454-4083-950e-a7f4ca4c06f5 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:31.986442 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:31.987101 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:31.987381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:31.987655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:31.997333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:31.998964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:32.008441 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1318/2674] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:26:42.887529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:42.898330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc099eb-e823-49fb-8c56-fdae99f07d43 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:42.902784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:42.903534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:42.903929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:42.904426 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:42.906422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:42.921680 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:42.923504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6157-ca2f-48d4-b535-ab1874f187fd service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:42.935350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1357/2675] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:43.165322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:43.166788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:43.181670 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30678802-c060-4b0e-89a0-2821a3a92d87 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:43.188007 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:43.188961 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:43.189464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:43.189919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] PATH_INFO: `/v3/users/d8ee03e501cf4453946c2eee7a96877c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:43.191706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ee03e501cf4453946c2eee7a96877c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:43.194266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:43.432139 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ee03e501cf4453946c2eee7a96877c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:43.433116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ee03e501cf4453946c2eee7a96877c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:43.442597 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ee03e501cf4453946c2eee7a96877c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:43.456975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ee03e501cf4453946c2eee7a96877c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:43.458164 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ee03e501cf4453946c2eee7a96877c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:43.564506 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1319/2676] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:26:43 2022] DELETE /identity/v3/users/d8ee03e501cf4453946c2eee7a96877c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:43.569187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:43.569482 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:43.569803 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:43.588162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:43.589413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:43.660537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1358/2677] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:43.668270 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:43.669916 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:43.733455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472d94b-ba20-4b50-b580-f67eaf8a9dd3 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:43.737532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af375-8838-4d44-be42-8b3f0537170f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:43.738231 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af375-8838-4d44-be42-8b3f0537170f service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:43.738501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af375-8838-4d44-be42-8b3f0537170f service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:43.738831 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af375-8838-4d44-be42-8b3f0537170f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:43.748912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af375-8838-4d44-be42-8b3f0537170f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:43.750379 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af375-8838-4d44-be42-8b3f0537170f service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:43.762708 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1320/2678] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:44.294354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:44.296621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:44.311951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae30f4-f2b0-432c-8d47-3e936ad1a752 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:44.319397 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:44.320860 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:44.322622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:44.322956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] PATH_INFO: `/v3/projects/067d74efc6f340749b593e01577f9686` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:44.324738 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=067d74efc6f340749b593e01577f9686)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:44.326925 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:44.446025 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067d74efc6f340749b593e01577f9686', 'request_id': 'req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:44.452692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067d74efc6f340749b593e01577f9686', 'request_id': 'req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:44.589818 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067d74efc6f340749b593e01577f9686', 'request_id': 'req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:44.602329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] The token cache is being invalidate because project 067d74efc6f340749b593e01577f9686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:26:44.602624 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:44.603346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-0502dbeb-c2bc-4e34-9a70-5a07c1256daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:44.605027 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1359/2679] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:26:44 2022] DELETE /identity/v3/projects/067d74efc6f340749b593e01577f9686 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:51.349263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db7da-cc4c-4423-be48-f786e7585586 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.349828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db7da-cc4c-4423-be48-f786e7585586 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.350681 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db7da-cc4c-4423-be48-f786e7585586 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.353410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1321/2680] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:26:51.359625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.361362 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.361855 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.396853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:51.404799 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:51.470637 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268db7da-cc4c-4423-be48-f786e7585586 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:51.472677 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-268db7da-cc4c-4423-be48-f786e7585586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:51.473977 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1360/2681] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:51.487862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:51.489231 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:51.551323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193eb43-6505-4076-a44a-82a1d0560ed1 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:51.551643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268db7da-cc4c-4423-be48-f786e7585586 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:51.554879 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abc381-0378-4049-a855-80e0c5cffe76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31782b5628be41e0a17c08dc6f2fa229', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:51.556065 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abc381-0378-4049-a855-80e0c5cffe76 service glance] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.556333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abc381-0378-4049-a855-80e0c5cffe76 service glance] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.556611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abc381-0378-4049-a855-80e0c5cffe76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.557410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:51.558386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.558714 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.558987 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] PATH_INFO: `/v3/users/5de5842af99a42378f2f59a6538fd6ca` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.560381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de5842af99a42378f2f59a6538fd6ca)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:51.562302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:51.568041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abc381-0378-4049-a855-80e0c5cffe76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:51.570710 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abc381-0378-4049-a855-80e0c5cffe76 service glance] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:51.582579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1361/2682] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:51.810995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a8e6-be5e-4237-aa94-9fa5c971316e None None] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.810995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a8e6-be5e-4237-aa94-9fa5c971316e None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.810995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a8e6-be5e-4237-aa94-9fa5c971316e None None] PATH_INFO: `/` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.810995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1362/2683] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:26:51.813465 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.813951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.814415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.814659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de5842af99a42378f2f59a6538fd6ca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:51.815349 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de5842af99a42378f2f59a6538fd6ca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:51.824250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de5842af99a42378f2f59a6538fd6ca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:51.835281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] MFA Rules not processed for user `f59d1deb46094936b5572bb6c5aa2f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:51.835987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:51.837908 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de5842af99a42378f2f59a6538fd6ca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:51.838875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-91f1ce55-da24-440f-8a26-9a129642f2db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de5842af99a42378f2f59a6538fd6ca'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:51.896197 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1363/2684] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:51.908483 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:51.909477 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:51.920633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fcf57-6d92-4ee8-b7c3-83edaca10be7 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:51.924435 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d33ff7-e6ab-4b65-9530-70c4678c31bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:51.925071 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d33ff7-e6ab-4b65-9530-70c4678c31bb service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:51.925347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d33ff7-e6ab-4b65-9530-70c4678c31bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:51.925616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d33ff7-e6ab-4b65-9530-70c4678c31bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:51.933639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d33ff7-e6ab-4b65-9530-70c4678c31bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:51.935154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d33ff7-e6ab-4b65-9530-70c4678c31bb service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:51.937619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1322/2685] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:26:51 2022] DELETE /identity/v3/users/5de5842af99a42378f2f59a6538fd6ca => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:26:51.943661 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1364/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:52.048338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa78de8-ea9b-475c-a2cd-5f7055067ef9 None None] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:52.048738 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa78de8-ea9b-475c-a2cd-5f7055067ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:52.049026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa78de8-ea9b-475c-a2cd-5f7055067ef9 None None] PATH_INFO: `/` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:52.050490 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1323/2687] 10.222.0.49 () {54 vars in 921 bytes} [Mon Apr 11 13:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:26:52.057210 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe036-7025-4af6-9148-075d861b694f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:52.057647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe036-7025-4af6-9148-075d861b694f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:52.058015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe036-7025-4af6-9148-075d861b694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:52.076704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-fccbe036-7025-4af6-9148-075d861b694f None None] MFA Rules not processed for user `b02c83e7079e45e7b8ae4b49ac15f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:52.077931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fccbe036-7025-4af6-9148-075d861b694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:52.144956 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1365/2688] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Apr 11 13:26:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:52.156110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa78de8-ea9b-475c-a2cd-5f7055067ef9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:52.213468 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa78de8-ea9b-475c-a2cd-5f7055067ef9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:52.217012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:52.217683 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:52.217962 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:52.218269 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:52.228856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:52.230337 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:52.237507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe036-7025-4af6-9148-075d861b694f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:52.239036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-fccbe036-7025-4af6-9148-075d861b694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:52.241760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1324/2689] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:26:52.316150 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe036-7025-4af6-9148-075d861b694f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:52.320652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:52.321562 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:52.321838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:52.322119 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] PATH_INFO: `/v3/projects/55f2507d26384db4a97b5bc46f4e55ba` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:52.323500 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f2507d26384db4a97b5bc46f4e55ba)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:52.325316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:52.470414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f2507d26384db4a97b5bc46f4e55ba', 'request_id': 'req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.478484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f2507d26384db4a97b5bc46f4e55ba', 'request_id': 'req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.611652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f2507d26384db4a97b5bc46f4e55ba', 'request_id': 'req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.624281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] The token cache is being invalidate because project 55f2507d26384db4a97b5bc46f4e55ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:26:52.624575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.625237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.629982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1366/2690] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:26:52 2022] DELETE /identity/v3/projects/55f2507d26384db4a97b5bc46f4e55ba => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:52.631128 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:52.642967 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8cf21-7433-41be-a1df-f02e1d5e007d service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:52.702500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:52.707096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:52.707096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:52.707096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] PATH_INFO: `/v3/users/3ae3b2a52b25448393c22d99c2e4f8fc` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:52.707096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae3b2a52b25448393c22d99c2e4f8fc)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:52.707096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:52.861929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae3b2a52b25448393c22d99c2e4f8fc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.862891 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae3b2a52b25448393c22d99c2e4f8fc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.871467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae3b2a52b25448393c22d99c2e4f8fc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.885210 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae3b2a52b25448393c22d99c2e4f8fc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.885951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-074e5f02-8aae-4742-a059-f7702f866381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae3b2a52b25448393c22d99c2e4f8fc'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:52.983182 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1325/2691] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:26:52 2022] DELETE /identity/v3/users/3ae3b2a52b25448393c22d99c2e4f8fc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:53.244737 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:53.246322 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:53.261466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c7139-fd13-495f-ad21-8fb05e5cafaf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:53.335473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:53.342712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:53.342712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:53.342712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] PATH_INFO: `/v3/projects/d8e5d74db9094fe6a38fd11c6b7161fd` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:53.342712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e5d74db9094fe6a38fd11c6b7161fd)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:53.342712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:53.486324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e5d74db9094fe6a38fd11c6b7161fd', 'request_id': 'req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:53.491901 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e5d74db9094fe6a38fd11c6b7161fd', 'request_id': 'req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:53.586554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e5d74db9094fe6a38fd11c6b7161fd', 'request_id': 'req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:53.601079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] The token cache is being invalidate because project d8e5d74db9094fe6a38fd11c6b7161fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:26:53.601374 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:53.602031 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-701b7e3e-0818-4fb7-ae8c-e6d276c6dfa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:26:53.604559 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1367/2692] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:26:53 2022] DELETE /identity/v3/projects/d8e5d74db9094fe6a38fd11c6b7161fd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:53.609712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:53.610002 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:53.610323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:53.628346 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:53.629547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:53.696041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1326/2693] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:53.705713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:53.705713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:53.705713 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:53.726269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:53.727707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:53.736984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1368/2694] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:26:53.741559 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:53.752362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58905c57-e757-4c88-9903-1048cbff2e86 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:53.757925 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:53.758706 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:53.759149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:53.763026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:53.763026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:26:53.763026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:53.763026 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:53.774694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1327/2695] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:26:53.779369 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:53.800578 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca285f1b-ad46-481c-bb4c-57be7f06e36d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:53.806417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:53.807127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:53.807407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:53.807677 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:53.809062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:53.810996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:53.922439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1369/2696] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:26:53.926680 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:53.936725 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90390-4fd5-4706-a29d-50ea0e0a585d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:53.994353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:53.994945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:53.995226 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:53.995596 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:53.996245 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:53.998249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:54.084018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1328/2697] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:26:53 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:26:54.089077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:54.099551 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aa565-69e7-4f6b-bc9b-9fd742516c15 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:54.107544 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:54.108212 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:54.108496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:54.108770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:54.109499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:54.111152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:54.123236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1370/2698] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:26:54.127317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:54.138233 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b185c4-50f3-4ea0-95cb-569d95cbc1bb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:54.143108 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9506c-555f-4e6c-820b-5faf55a8cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:54.147571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9506c-555f-4e6c-820b-5faf55a8cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:54.147571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9506c-555f-4e6c-820b-5faf55a8cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:54.147571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9506c-555f-4e6c-820b-5faf55a8cfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:54.147571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9506c-555f-4e6c-820b-5faf55a8cfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:54.147571 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9506c-555f-4e6c-820b-5faf55a8cfeb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:54.159009 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1329/2699] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:26:54.163221 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:54.177252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866ba1-7e5d-4c96-857d-fef2c5c08cee admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:54.183474 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:54.184387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:54.184670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:54.184948 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] PATH_INFO: `/v3/projects/31c04750f0ea4e5a87fdbde19c5b91a5/users/ea45e26ac8bf48028714037a5582712b/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:54.214480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c04750f0ea4e5a87fdbde19c5b91a5, user_id=ea45e26ac8bf48028714037a5582712b, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:54.214480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:54.292719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1371/2700] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:26:54 2022] PUT /identity/v3/projects/31c04750f0ea4e5a87fdbde19c5b91a5/users/ea45e26ac8bf48028714037a5582712b/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:26:54.298137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5f43-9ca0-4ca3-a0e0-86620032f379 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:54.298563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5f43-9ca0-4ca3-a0e0-86620032f379 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:54.298942 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5f43-9ca0-4ca3-a0e0-86620032f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:54.318603 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a91a5f43-9ca0-4ca3-a0e0-86620032f379 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:54.319828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a91a5f43-9ca0-4ca3-a0e0-86620032f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:54.378484 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1330/2701] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:54.389857 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:54.391372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:54.451812 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d20e09-fa82-47d5-840e-91f5a21333e4 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:54.455718 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c05d7-35ec-499f-9b31-b6b720cc2886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:54.456408 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c05d7-35ec-499f-9b31-b6b720cc2886 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:54.456750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c05d7-35ec-499f-9b31-b6b720cc2886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:54.457029 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c05d7-35ec-499f-9b31-b6b720cc2886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:54.466850 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c05d7-35ec-499f-9b31-b6b720cc2886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:54.468276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c05d7-35ec-499f-9b31-b6b720cc2886 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:54.478476 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1372/2702] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:26:55.262759 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:55.263278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:55.263375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:55.282312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] MFA Rules not processed for user `0053f012b7454645867a430706494125`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:55.283589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:55.350496 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1331/2703] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:26:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:56.843521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c48cce-d786-4ce7-8f2f-01b08de23698 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:56.843521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c48cce-d786-4ce7-8f2f-01b08de23698 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:56.843521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c48cce-d786-4ce7-8f2f-01b08de23698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:56.862996 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e4c48cce-d786-4ce7-8f2f-01b08de23698 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:26:56.864359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e4c48cce-d786-4ce7-8f2f-01b08de23698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:56.941223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1373/2704] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:26:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:26:56.954447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:26:56.955875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:26:57.068641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087bb96-f2df-4272-baf5-59fc4f32a871 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:26:57.074368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:26:57.075036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:26:57.075413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:26:57.075697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:26:57.084938 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:26:57.087087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:26:57.095500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1332/2705] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:26:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:27:02.610075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:02.610075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:02.610075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:02.686893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] MFA Rules not processed for user `ea45e26ac8bf48028714037a5582712b`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:02.688919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:02.808441 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1374/2706] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:02.812801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:02.825901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b3c68-a47e-48ad-93ab-61f609a34f4d service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:02.830892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:02.831629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:02.831928 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:02.832207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:02.832969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:02.835022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:02.930640 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1333/2707] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:27:02 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:27:02.933179 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:02.953484 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e363c-3f2b-496d-b36d-7c5043ac120b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:03.053020 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:03.054281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:03.054733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:03.055193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:03.057093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:03.059748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:03.177110 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1375/2708] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:27:02 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:27:03.178362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:03.191130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551e3ef-832f-4c11-952d-bed84fc6f47c admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:03.196838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:03.197667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:03.203657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:03.203657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:03.203657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:03.203657 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:03.218852 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1334/2709] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:27:03.220146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:03.233501 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e46c8-3cf9-414a-b57d-f75105f73129 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:03.245689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:03.260745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:03.261032 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:03.261313 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] PATH_INFO: `/v3/projects/ab0d4cda468842aaa5f71f9c33f393d6/users/29f78c7e87df4253931031542403a10c/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:03.277900 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0d4cda468842aaa5f71f9c33f393d6, user_id=29f78c7e87df4253931031542403a10c, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:03.280611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:03.406795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1376/2710] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:27:03 2022] PUT /identity/v3/projects/ab0d4cda468842aaa5f71f9c33f393d6/users/29f78c7e87df4253931031542403a10c/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:27:03.410768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:03.432784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35293c-4ba0-4589-a141-468fb52e183b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:03.556959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2c16b-1f28-4708-a154-71149e141367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:03.557674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2c16b-1f28-4708-a154-71149e141367 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:03.557953 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2c16b-1f28-4708-a154-71149e141367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:03.558266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2c16b-1f28-4708-a154-71149e141367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:03.559005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2c16b-1f28-4708-a154-71149e141367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:03.560649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2c16b-1f28-4708-a154-71149e141367 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:03.576268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1335/2711] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:27:03.577412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:03.590898 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be9cc-68d8-4622-afb4-ecce675bb9a9 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:03.596519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:03.597724 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:03.597913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:03.598240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] PATH_INFO: `/v3/projects/ab0d4cda468842aaa5f71f9c33f393d6/users/29f78c7e87df4253931031542403a10c/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:03.608655 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0d4cda468842aaa5f71f9c33f393d6, user_id=29f78c7e87df4253931031542403a10c, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:03.611950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:03.624828 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1377/2712] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:27:03 2022] PUT /identity/v3/projects/ab0d4cda468842aaa5f71f9c33f393d6/users/29f78c7e87df4253931031542403a10c/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:27:11.722731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d97a67-58ee-479f-9f60-6f8a474f16e5 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:11.723735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d97a67-58ee-479f-9f60-6f8a474f16e5 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:11.724115 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d97a67-58ee-479f-9f60-6f8a474f16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:11.759610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c8d97a67-58ee-479f-9f60-6f8a474f16e5 None None] MFA Rules not processed for user `29f78c7e87df4253931031542403a10c`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:11.760970 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c8d97a67-58ee-479f-9f60-6f8a474f16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:11.846851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1336/2713] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:11.859154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:11.861037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:11.937269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6881e-befb-43d2-8f19-4f45e51296f7 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:11.942811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:11.943422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:11.943703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:11.943974 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:12.000701 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:12.002287 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:12.011813 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1378/2714] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:27:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:27:18.609570 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bef7-265c-45da-9d80-ce87f1767118 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:18.610159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bef7-265c-45da-9d80-ce87f1767118 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:18.610159 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bef7-265c-45da-9d80-ce87f1767118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:18.628740 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c809bef7-265c-45da-9d80-ce87f1767118 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:18.629912 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c809bef7-265c-45da-9d80-ce87f1767118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:18.687839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1337/2715] 10.222.0.49 () {58 vars in 967 bytes} [Mon Apr 11 13:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:18.700910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:18.770563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d904-67df-4640-860d-1259c852efc8 service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:18.775546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:18.776192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:18.776473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:18.776750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:18.785003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:18.786688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:18.796469 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1379/2716] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:27:27.584134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93817c-3450-4e4e-a937-fe36f695b26a None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:27.584642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93817c-3450-4e4e-a937-fe36f695b26a None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:27.584773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93817c-3450-4e4e-a937-fe36f695b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:27.602905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2d93817c-3450-4e4e-a937-fe36f695b26a None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:27.605728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2d93817c-3450-4e4e-a937-fe36f695b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:27.612656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1338/2717] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:27.625152 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:27.635815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ef6f-1f25-40ba-a8ae-10b7c62f8ef0 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:27.641804 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4fadc-ffca-462c-a905-5d0a2b3a0c55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:27.642415 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4fadc-ffca-462c-a905-5d0a2b3a0c55 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:27.642699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4fadc-ffca-462c-a905-5d0a2b3a0c55 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:27.642972 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4fadc-ffca-462c-a905-5d0a2b3a0c55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:27.651107 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4fadc-ffca-462c-a905-5d0a2b3a0c55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:27.652670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4fadc-ffca-462c-a905-5d0a2b3a0c55 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:27.661470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1380/2718] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:27:32.173135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:32.173715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:32.173715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:32.197239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] MFA Rules not processed for user `ea45e26ac8bf48028714037a5582712b`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:32.198519 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:32.207512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1339/2719] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:45.836978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:45.837439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:45.837637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:45.858196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:45.859409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:45.866715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1381/2720] 10.222.0.49 () {58 vars in 967 bytes} [Mon Apr 11 13:27:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:45.879742 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:45.892100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c5bc-dbd0-4c58-9826-567498344f13 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:45.897608 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:45.898362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:45.898661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:45.898911 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:45.908075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:45.909776 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:45.918195 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1340/2721] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:27:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:27:49.330736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:49.332193 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:49.400403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0631a7-5517-4743-8c34-9ad6c5060548 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:49.407683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:49.407683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:49.407683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:49.407683 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] PATH_INFO: `/v3/users/0053f012b7454645867a430706494125` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:49.408335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0053f012b7454645867a430706494125)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:49.410349 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:49.610955 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0053f012b7454645867a430706494125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:49.677312 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0053f012b7454645867a430706494125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:49.685555 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0053f012b7454645867a430706494125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:49.696937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0053f012b7454645867a430706494125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:49.697591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-9ebb48bb-1f5c-4199-a5e7-6931d734b44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0053f012b7454645867a430706494125'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:49.703663 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1382/2722] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:27:49 2022] DELETE /identity/v3/users/0053f012b7454645867a430706494125 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:27:49.979433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:49.995470 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7203d-54ed-44f2-835e-feb06de0e102 service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.061075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.061956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.062275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.062554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] PATH_INFO: `/v3/projects/2911e29b2a1c4ae0b0a349dcf665ace3` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.063917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2911e29b2a1c4ae0b0a349dcf665ace3)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.065862 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.187964 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2911e29b2a1c4ae0b0a349dcf665ace3', 'request_id': 'req-2ffa699a-8a08-48b5-a489-c980ec7490f8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:50.193704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2911e29b2a1c4ae0b0a349dcf665ace3', 'request_id': 'req-2ffa699a-8a08-48b5-a489-c980ec7490f8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:50.259665 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2911e29b2a1c4ae0b0a349dcf665ace3', 'request_id': 'req-2ffa699a-8a08-48b5-a489-c980ec7490f8'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:50.272368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] The token cache is being invalidate because project 2911e29b2a1c4ae0b0a349dcf665ace3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:27:50.272660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:50.273340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2ffa699a-8a08-48b5-a489-c980ec7490f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:27:50.275000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1341/2723] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:27:49 2022] DELETE /identity/v3/projects/2911e29b2a1c4ae0b0a349dcf665ace3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:27:50.281823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.285299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.285299 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.303187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:50.304411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:50.364377 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1383/2724] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:50.372667 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.372957 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.373240 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.393391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:50.394684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:50.402848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1342/2725] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:50.407839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:50.417361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733707-2623-4cfe-96bd-cd135fd3fac8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.422567 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.423237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.423519 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.423795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.424534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:27:50.424840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.426452 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.442081 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1384/2726] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:27:50.443642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:50.460359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e3f3c-059f-48fd-8006-3e00ff9435f0 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.465284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.466941 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.467261 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.467574 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.468312 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.470324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.555951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1343/2727] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:27:50 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:27:50.559880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:50.577169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe56c-49ad-4ebe-a7c2-fd83ed92bb25 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.654422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.655100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.655384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.655670 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.656356 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.658288 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.740502 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1385/2728] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:27:50 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:27:50.744333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:50.755300 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4880350-f927-4346-9f18-2055950b58dc admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.760568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.760766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.761031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.761304 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.762029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.764424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.775135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1344/2729] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:27:50.779682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:50.789608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790e586-a6b2-4453-ae83-adee1ae3a648 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.794446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5ac6c-13fc-4cb7-9aa5-274987cbd7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.795099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5ac6c-13fc-4cb7-9aa5-274987cbd7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.795381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5ac6c-13fc-4cb7-9aa5-274987cbd7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.795658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5ac6c-13fc-4cb7-9aa5-274987cbd7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.796382 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5ac6c-13fc-4cb7-9aa5-274987cbd7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.797957 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5ac6c-13fc-4cb7-9aa5-274987cbd7a4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.807647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1386/2730] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:27:50.813138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:50.823411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402f8c3-e2e5-4dc9-b410-2d70c263c9c8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:50.828840 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:50.829729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.830012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.830324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] PATH_INFO: `/v3/projects/eea7d18367ba4ce39458b5a8f0d0fc8a/users/e28f589267db429a865ae4657e323338/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.846821 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea7d18367ba4ce39458b5a8f0d0fc8a, user_id=e28f589267db429a865ae4657e323338, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:50.849630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:50.931671 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1345/2731] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:27:50 2022] PUT /identity/v3/projects/eea7d18367ba4ce39458b5a8f0d0fc8a/users/e28f589267db429a865ae4657e323338/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:27:50.937021 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f6e9b-adb4-46e0-82ad-80236039f4df None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:50.937355 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f6e9b-adb4-46e0-82ad-80236039f4df None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:50.937694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f6e9b-adb4-46e0-82ad-80236039f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:50.956345 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-5a6f6e9b-adb4-46e0-82ad-80236039f4df None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:50.957566 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5a6f6e9b-adb4-46e0-82ad-80236039f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:51.016265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1387/2732] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:51.025901 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:51.027653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:51.088230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ec65-6e02-4b0d-aaf6-5d5df1e16c38 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:51.092890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:51.093537 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:51.093819 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:51.094092 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:51.103360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:51.104782 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:51.115265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1346/2733] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:27:52.900361 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01774-053f-44bf-b9cf-67b213abc6a3 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:52.901354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01774-053f-44bf-b9cf-67b213abc6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:52.902591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01774-053f-44bf-b9cf-67b213abc6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:52.931743 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-49f01774-053f-44bf-b9cf-67b213abc6a3 None None] MFA Rules not processed for user `e28f589267db429a865ae4657e323338`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:52.933427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-49f01774-053f-44bf-b9cf-67b213abc6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:53.004217 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1388/2734] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:53.020041 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:53.022059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:53.096143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee782-b743-4ac5-b36e-9fd064a6f7d8 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:53.100366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:53.102784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:53.102784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:53.102784 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:53.111069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:53.112524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:53.122764 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1347/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:27:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:27:54.829503 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb8cec-a675-4839-a01c-046eac8a7192 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:54.830064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb8cec-a675-4839-a01c-046eac8a7192 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:54.830064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb8cec-a675-4839-a01c-046eac8a7192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:54.848496 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-90bb8cec-a675-4839-a01c-046eac8a7192 None None] MFA Rules not processed for user `e28f589267db429a865ae4657e323338`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:27:54.849705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-90bb8cec-a675-4839-a01c-046eac8a7192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:54.856682 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1389/2736] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:27:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:27:55.408666 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:27:55.417954 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d373-d548-4c1d-b45e-60b6a662ecba service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:27:55.421694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:27:55.422369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:27:55.422646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:27:55.422917 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:27:55.424746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:27:55.494546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:27:55.497467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:27:55.515201 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1348/2737] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:27:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:28:11.895739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:28:11.896251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:28:11.896366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:28:11.917234 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] MFA Rules not processed for user `8606d71db6ef4957a055466af7de83b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:28:11.918984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:28:11.994965 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1390/2738] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:28:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:28:52.567856 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:28:52.577097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288e9fb-2372-48a0-9554-579fa21a3236 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:28:52.580785 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:28:52.581424 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:28:52.581704 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:28:52.581980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:28:52.583803 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:28:52.652915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:28:52.654375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f009-662e-437d-a25a-2e16c98f9737 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:28:52.665544 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1349/2739] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:28:55.659600 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:28:55.661078 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:28:55.674086 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c290e4-68ad-4a05-b04a-a6f5c08520a8 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:28:55.678014 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:28:55.678457 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:28:55.678740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:28:55.679016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:28:55.680797 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:28:55.695285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:28:55.696705 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:28:55.708241 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1391/2740] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:28:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:29:08.579554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:08.580089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:08.580089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:08.598299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] MFA Rules not processed for user `e28f589267db429a865ae4657e323338`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:29:08.599505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:08.606775 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1350/2741] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:29:09.261201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:29:09.262844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:09.334173 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0964690-90ae-484c-89c3-06bb6061b974 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:29:09.340074 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:29:09.340885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:09.341165 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:09.341438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:09.343417 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:09.355535 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:29:09.357232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:29:09.367203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1392/2742] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:29:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:29:12.353614 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:29:12.364624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6659e-264e-4078-b94f-6da3a137867c None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:29:12.368978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:29:12.369618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:12.369896 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:12.370239 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:12.372504 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:12.382313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:29:12.384141 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0dc15-8ca8-40ab-92ad-54baa2376d33 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:29:12.393422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1351/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:29:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:29:13.543581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:29:13.545883 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:13.567604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af955902-2ec8-4bfc-857a-a88cce1f831a service placement] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:29:13.573186 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:29:13.574359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:13.574640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:13.574913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:13.576772 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:13.590048 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:29:13.591733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:29:13.603899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1393/2744] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:29:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:29:38.901885 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:38.902643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:38.902643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:38.921689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:29:38.923630 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:38.987005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1352/2745] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:29:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:29:39.134054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:29:39.136252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:39.202591 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a822bae-229b-4127-823f-265eb8a1916c service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:29:39.207579 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a370e-790a-40e4-9046-569317529658 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:29:39.208255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a370e-790a-40e4-9046-569317529658 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:39.208538 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a370e-790a-40e4-9046-569317529658 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:39.208811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a370e-790a-40e4-9046-569317529658 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:39.217306 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a370e-790a-40e4-9046-569317529658 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:29:39.218913 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a370e-790a-40e4-9046-569317529658 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:29:39.226895 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1394/2746] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:29:48.234943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:29:48.254888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34717bb-35b8-4748-9459-c7011476be46 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:29:48.264310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:29:48.265149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:48.265607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:48.266135 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:48.267889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:48.294836 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:29:48.296674 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d17ef6-a833-41f1-953c-d96350ab5466 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:29:48.307880 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1353/2747] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:29:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:29:54.204443 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a370e-790a-40e4-9046-569317529658 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:29:54.207010 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-d84a370e-790a-40e4-9046-569317529658 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:54.223686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a370e-790a-40e4-9046-569317529658 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:29:54.229970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:29:54.230248 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:29:54.230529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:29:54.230858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:29:54.232731 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:29:54.246822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:29:54.248582 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:29:54.260587 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1395/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:29:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:30:05.802973 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c83bc-1b90-4ec3-b6aa-c15083b77b6b None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:05.803643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c83bc-1b90-4ec3-b6aa-c15083b77b6b None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:05.803643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c83bc-1b90-4ec3-b6aa-c15083b77b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:05.831805 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-d79c83bc-1b90-4ec3-b6aa-c15083b77b6b None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:30:05.832995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-d79c83bc-1b90-4ec3-b6aa-c15083b77b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:05.870314 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1354/2749] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Apr 11 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:30:05.880422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:30:05.922072 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b92cf-3d99-4f24-abcd-12664dfc61ce service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:30:05.927923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:30:05.927923 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:05.928139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:05.928239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:05.936979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:30:05.938593 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:30:05.946488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1396/2750] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:30:06.611027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:06.611383 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:06.611732 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:06.633817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] MFA Rules not processed for user `ea45e26ac8bf48028714037a5582712b`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:30:06.636127 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:06.701676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1355/2751] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:30:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:30:07.046924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:30:07.079688 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145b54-26c4-436f-b5f0-b106b2d201f1 service swift] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:30:07.083878 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:30:07.084471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:07.084751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:07.085028 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:07.087006 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:07.116184 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:30:07.118841 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:30:07.129686 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1397/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:30:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:30:15.931384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:30:15.961422 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3654f4-520e-4cde-925a-e2226de495a9 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:30:15.969238 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:30:15.970168 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:15.970451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:15.970724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] PATH_INFO: `/v3/users/e28f589267db429a865ae4657e323338` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:15.971907 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28f589267db429a865ae4657e323338)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:30:15.973812 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:30:16.148513 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28f589267db429a865ae4657e323338'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.149174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28f589267db429a865ae4657e323338'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.157242 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28f589267db429a865ae4657e323338'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.170895 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28f589267db429a865ae4657e323338'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.171644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28f589267db429a865ae4657e323338'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.254511 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1356/2753] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:30:15 2022] DELETE /identity/v3/users/e28f589267db429a865ae4657e323338 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:30:16.559117 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:30:16.571916 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec33a6a-7347-4a40-8ae8-1068389b6c50 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:30:16.640577 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:30:16.644470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:16.644470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:16.644470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] PATH_INFO: `/v3/projects/eea7d18367ba4ce39458b5a8f0d0fc8a` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:16.644470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea7d18367ba4ce39458b5a8f0d0fc8a)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:30:16.645793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:30:16.807232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea7d18367ba4ce39458b5a8f0d0fc8a', 'request_id': 'req-06116589-d566-4a34-9ab1-5bf68a758b46'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.814196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea7d18367ba4ce39458b5a8f0d0fc8a', 'request_id': 'req-06116589-d566-4a34-9ab1-5bf68a758b46'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.911604 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea7d18367ba4ce39458b5a8f0d0fc8a', 'request_id': 'req-06116589-d566-4a34-9ab1-5bf68a758b46'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.939887 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] The token cache is being invalidate because project eea7d18367ba4ce39458b5a8f0d0fc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:30:16.942821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.942821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-06116589-d566-4a34-9ab1-5bf68a758b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:30:16.942821 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1398/2754] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:30:16 2022] DELETE /identity/v3/projects/eea7d18367ba4ce39458b5a8f0d0fc8a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:30:18.588979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:30:18.591410 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:18.702461 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364e35f-6154-4e6a-9c3c-ec9219803109 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:30:18.779051 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:30:18.780040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:18.780448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:18.781697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:18.785532 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:18.803298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:30:18.805281 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:30:18.817034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1357/2755] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:30:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:30:22.368997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:22.369466 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:22.369564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:22.387318 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] MFA Rules not processed for user `140c9cd9be1945ef98619be5d3cc84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:30:22.388742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:22.443616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1399/2756] 10.222.0.49 () {58 vars in 967 bytes} [Mon Apr 11 13:30:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:30:22.456718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:30:22.458157 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:30:22.524687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79972e9-fd39-4f4d-92e2-c776164d2362 service nova] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:30:22.529866 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d78c88153b34e0191d934a30bcb1f1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:30:22.530542 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:30:22.530826 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:30:22.531100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:30:22.539082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:30:22.540660 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:30:22.548653 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1358/2757] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Apr 11 13:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:31:05.390673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:05.392154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:05.447199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840aab2-85ce-4a57-99c2-4170d950d07d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:05.450784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:05.451433 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:05.451715 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:05.451992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:05.454411 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:05.519030 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:05.520478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:05.532145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1400/2758] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:09.305886 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:09.307488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:09.322649 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6781db-2574-40e1-ac86-85940083c52e service swift] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:09.335888 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:09.336975 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:09.337255 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:09.337527 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] PATH_INFO: `/v3/users/8606d71db6ef4957a055466af7de83b6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:09.339089 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8606d71db6ef4957a055466af7de83b6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:09.341118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:09.552813 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8606d71db6ef4957a055466af7de83b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:09.553475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8606d71db6ef4957a055466af7de83b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:09.560386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8606d71db6ef4957a055466af7de83b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:09.572212 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8606d71db6ef4957a055466af7de83b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:09.578958 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-502398c7-b31e-4f6d-a98d-7e54045cb22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8606d71db6ef4957a055466af7de83b6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:09.663893 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1359/2759] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:09 2022] DELETE /identity/v3/users/8606d71db6ef4957a055466af7de83b6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:09.946333 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:09.960022 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606bebd-379d-4d87-b6e5-5acc61d62224 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.016631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.017504 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.017790 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.018069 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] PATH_INFO: `/v3/projects/4b0f1fe37bda4d2c93681cc6b37d690c` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.019303 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0f1fe37bda4d2c93681cc6b37d690c)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.021240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.168697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0f1fe37bda4d2c93681cc6b37d690c', 'request_id': 'req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:10.174837 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0f1fe37bda4d2c93681cc6b37d690c', 'request_id': 'req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:10.259225 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0f1fe37bda4d2c93681cc6b37d690c', 'request_id': 'req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:10.276051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] The token cache is being invalidate because project 4b0f1fe37bda4d2c93681cc6b37d690c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:10.276494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:10.277421 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-7c28808c-344b-4aa5-9ad5-d9c09f6435a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:10.279798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1401/2760] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:09 2022] DELETE /identity/v3/projects/4b0f1fe37bda4d2c93681cc6b37d690c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:10.285292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.285593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.285847 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.342471 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:10.344185 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:10.403835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1360/2761] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:10.412973 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.413262 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.413540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.432749 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:10.433960 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:10.442309 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1402/2762] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:10.446635 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:10.456294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0e247-edb9-4882-afa4-636c14290345 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.462030 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.462735 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.463019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.463295 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.464152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:10.464467 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.466084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.478721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1361/2763] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:10.483108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:10.493295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be274209-026e-46d4-a2c7-9107a914b2b6 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.498084 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.498792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.499108 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.499353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.500079 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.501978 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.619975 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1403/2764] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:10 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:10.624554 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:10.635502 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17d755-9915-4feb-8a3f-a3371959f9e1 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.692643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.693313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.693595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.693894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.694629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.696546 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.785163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1362/2765] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:10 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:10.789390 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:10.800368 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b706d3-290d-4285-85d0-2af303f90e40 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.805226 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.805929 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.806244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.806521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.807258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.808893 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.822139 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1404/2766] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:10.826262 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:10.836767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22b05-1277-416a-8590-5a7e1d0f9ec2 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.841371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724eedd-dbae-454c-8554-03330b8d2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.842027 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724eedd-dbae-454c-8554-03330b8d2249 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.842334 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724eedd-dbae-454c-8554-03330b8d2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.843250 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724eedd-dbae-454c-8554-03330b8d2249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.843979 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724eedd-dbae-454c-8554-03330b8d2249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.845551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724eedd-dbae-454c-8554-03330b8d2249 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.856025 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1363/2767] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:31:10.859999 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:10.869667 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa394283-807c-4f50-9d2e-568d4b2d07bd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:10.874468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:10.875479 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.875795 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.876075 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] PATH_INFO: `/v3/projects/4f9f55c6600e4552ad9fffcb10476fbb/users/7f9e08df80a141919960dd15ee2ec5ff/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:10.892159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9f55c6600e4552ad9fffcb10476fbb, user_id=7f9e08df80a141919960dd15ee2ec5ff, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:10.894870 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:10.973853 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1405/2768] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:10 2022] PUT /identity/v3/projects/4f9f55c6600e4552ad9fffcb10476fbb/users/7f9e08df80a141919960dd15ee2ec5ff/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:10.984541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:10.984824 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:10.985107 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.013075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] MFA Rules not processed for user `7f9e08df80a141919960dd15ee2ec5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:11.014311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:11.078211 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1364/2769] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:11.082770 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.145864 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5928b42-a9cd-40a1-b853-0426a54b83d5 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.150882 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.151608 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.151951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.152276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.153059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.155427 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.244858 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1406/2770] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:11 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:11.250014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.261055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66c12-8485-44cb-ac4a-b74e8e96d829 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.318088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.318788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.319070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.319347 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.320054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.321980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.430310 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1365/2771] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:11 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:31:11.434357 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.447207 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6212c46-2c06-4619-8926-9ef3352cdd07 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.451937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.452635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.452941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.453209 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.453950 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.455572 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.466527 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1407/2772] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:11.471828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.482411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e0f27-9191-461e-96f4-9874819022a6 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.487716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.488623 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.488904 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.489180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] PATH_INFO: `/v3/projects/151d30a8f3f846c195a4218eb8d08f52/users/15e7ee6a6983492585ea13c55a22cd0e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.504771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=151d30a8f3f846c195a4218eb8d08f52, user_id=15e7ee6a6983492585ea13c55a22cd0e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.507697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.607418 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1366/2773] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:11 2022] PUT /identity/v3/projects/151d30a8f3f846c195a4218eb8d08f52/users/15e7ee6a6983492585ea13c55a22cd0e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:31:11.612122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.622007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8116-4fd1-4104-ad01-b5e2a21e2346 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.679127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f49d3-6ee0-466d-8b56-41472eb0b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.679838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f49d3-6ee0-466d-8b56-41472eb0b817 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.680120 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f49d3-6ee0-466d-8b56-41472eb0b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.680449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f49d3-6ee0-466d-8b56-41472eb0b817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.681125 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f49d3-6ee0-466d-8b56-41472eb0b817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.682780 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f49d3-6ee0-466d-8b56-41472eb0b817 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.693716 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1408/2774] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:11.698054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.709592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a065a-48c4-41ab-ae49-2a8ef1ca5d2d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.714247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.715134 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.715413 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.715684 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] PATH_INFO: `/v3/projects/151d30a8f3f846c195a4218eb8d08f52/users/15e7ee6a6983492585ea13c55a22cd0e/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.718174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151d30a8f3f846c195a4218eb8d08f52, user_id=15e7ee6a6983492585ea13c55a22cd0e, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.720974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.731804 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1367/2775] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:11 2022] PUT /identity/v3/projects/151d30a8f3f846c195a4218eb8d08f52/users/15e7ee6a6983492585ea13c55a22cd0e/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:11.743155 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.743449 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.743736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.771191 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] MFA Rules not processed for user `15e7ee6a6983492585ea13c55a22cd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:11.772416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:11.841816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1409/2776] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:11.855303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:11.856976 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:11.937458 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf76b7-ee3f-4a41-8ca6-3d3522228de8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:11.941075 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:11.941731 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:11.942001 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:11.942299 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:11.951477 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:11.952909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:11.962474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1368/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:12.092871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:12.094494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:12.106554 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0ef8a-13f3-4b67-ac80-afdf92b24a6b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:12.110911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35df0e-e90b-47d8-b6ab-12f62fa80927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:12.111563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35df0e-e90b-47d8-b6ab-12f62fa80927 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:12.111880 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35df0e-e90b-47d8-b6ab-12f62fa80927 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:12.112158 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35df0e-e90b-47d8-b6ab-12f62fa80927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:12.169219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35df0e-e90b-47d8-b6ab-12f62fa80927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:12.171407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35df0e-e90b-47d8-b6ab-12f62fa80927 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:12.180892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1410/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:17.507741 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:17.569384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae204c8-d1dd-49ec-93c8-fafc64dc391f service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:17.573829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:17.574743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:17.575010 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:17.575302 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] PATH_INFO: `/v3/users/7f9e08df80a141919960dd15ee2ec5ff` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:17.576493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9e08df80a141919960dd15ee2ec5ff)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:17.578493 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:17.913491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9e08df80a141919960dd15ee2ec5ff'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:17.914172 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9e08df80a141919960dd15ee2ec5ff'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:17.921918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9e08df80a141919960dd15ee2ec5ff'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:17.933729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9e08df80a141919960dd15ee2ec5ff'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:17.934503 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9e08df80a141919960dd15ee2ec5ff'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:18.038318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1369/2779] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:17 2022] DELETE /identity/v3/users/7f9e08df80a141919960dd15ee2ec5ff => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:18.042981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:18.043485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:18.043589 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:18.062995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:18.064201 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:18.125979 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1411/2780] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:18.138539 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:18.140872 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:18.198274 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772d01e-1f08-4c76-8ffe-142d939e5d77 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:18.202353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:18.203005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:18.203280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:18.203551 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:18.213034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:18.214508 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:18.225360 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1370/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:18.678485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:18.680083 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:18.692635 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9804e05-b654-473f-9e96-be1a0f1a525b None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:18.697581 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:18.698485 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:18.698764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:18.699088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] PATH_INFO: `/v3/projects/4f9f55c6600e4552ad9fffcb10476fbb` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:18.700324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9f55c6600e4552ad9fffcb10476fbb)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:18.702478 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:18.861673 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9f55c6600e4552ad9fffcb10476fbb', 'request_id': 'req-76209d19-be11-4822-bbcd-a21d1c3bdacf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:18.867507 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9f55c6600e4552ad9fffcb10476fbb', 'request_id': 'req-76209d19-be11-4822-bbcd-a21d1c3bdacf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:18.916645 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9f55c6600e4552ad9fffcb10476fbb', 'request_id': 'req-76209d19-be11-4822-bbcd-a21d1c3bdacf'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:18.929499 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] The token cache is being invalidate because project 4f9f55c6600e4552ad9fffcb10476fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:18.929778 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:18.930438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:18.932142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1412/2782] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:18 2022] DELETE /identity/v3/projects/4f9f55c6600e4552ad9fffcb10476fbb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:18.936489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:18.946351 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a123b-958f-413d-afe9-2c80f3f9bb28 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:19.004200 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:19.005059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:19.005330 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:19.005610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] PATH_INFO: `/v3/users/15e7ee6a6983492585ea13c55a22cd0e` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:19.006838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e7ee6a6983492585ea13c55a22cd0e)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:19.008995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:19.244205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e7ee6a6983492585ea13c55a22cd0e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:19.244905 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e7ee6a6983492585ea13c55a22cd0e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:19.252587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e7ee6a6983492585ea13c55a22cd0e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:19.266087 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e7ee6a6983492585ea13c55a22cd0e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:19.266767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2c78b0f7-ba71-4a11-b53e-10b678eec32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e7ee6a6983492585ea13c55a22cd0e'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:19.358612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1371/2783] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:18 2022] DELETE /identity/v3/users/15e7ee6a6983492585ea13c55a22cd0e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:19.843352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:19.844976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:19.862648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76209d19-be11-4822-bbcd-a21d1c3bdacf admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:19.923740 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:19.924784 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:19.925162 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:19.925546 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] PATH_INFO: `/v3/projects/151d30a8f3f846c195a4218eb8d08f52` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:19.927036 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=151d30a8f3f846c195a4218eb8d08f52)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:19.929329 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.120563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151d30a8f3f846c195a4218eb8d08f52', 'request_id': 'req-ef80b80e-e37f-417a-8087-b1444645dd7f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:20.126637 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151d30a8f3f846c195a4218eb8d08f52', 'request_id': 'req-ef80b80e-e37f-417a-8087-b1444645dd7f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:20.258838 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151d30a8f3f846c195a4218eb8d08f52', 'request_id': 'req-ef80b80e-e37f-417a-8087-b1444645dd7f'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:20.271753 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] The token cache is being invalidate because project 151d30a8f3f846c195a4218eb8d08f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:20.272061 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:20.272720 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ef80b80e-e37f-417a-8087-b1444645dd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:20.274325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1413/2784] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:19 2022] DELETE /identity/v3/projects/151d30a8f3f846c195a4218eb8d08f52 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:20.279247 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.285563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.285563 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.298369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:20.299604 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:20.358096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1372/2785] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:20.366690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.367017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.367237 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.387073 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:20.388062 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:20.402033 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1414/2786] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:20.407355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:20.417084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7788c8-dc86-42f3-ac56-9625462ab157 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:20.422658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:20.423325 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.423727 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.424013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.424750 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:20.425058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:20.426700 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.439728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1373/2787] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:20.444294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:20.453699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd471-596e-4279-9ace-44c1e0971c44 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:20.458557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:20.459222 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.459505 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.459827 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.460494 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:20.462431 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.588324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1415/2788] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:20 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:20.589661 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:20.600921 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725860e-b3cc-44bf-b24a-e00d6fec59c5 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:20.660331 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:20.661048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.661339 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.661616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.662436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:20.664387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.767258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1374/2789] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:20 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:20.771689 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:20.788734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be9352-4eb0-4dea-8fd1-d2283825a747 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:20.788734 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:20.789094 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.789270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.789552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.790330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:20.792126 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.804678 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1416/2790] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:20.808948 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:20.819053 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41cef5-38fc-4d0c-b8c7-84d694295844 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:20.823818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8342a-4377-46df-b11e-674d808f6eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:20.824483 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8342a-4377-46df-b11e-674d808f6eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.824768 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8342a-4377-46df-b11e-674d808f6eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.825049 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8342a-4377-46df-b11e-674d808f6eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.825780 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8342a-4377-46df-b11e-674d808f6eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:20.827501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8342a-4377-46df-b11e-674d808f6eeb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.838131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1375/2791] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:20.842640 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:20.854317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f370-5649-4901-9c42-49966b3e83e1 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:20.859456 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:20.860324 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:20.860599 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:20.860868 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] PATH_INFO: `/v3/projects/5adb6413856249848547501686316214/users/7d0e996b82474ae2bf62d21fcbb1d373/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:20.875693 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adb6413856249848547501686316214, user_id=7d0e996b82474ae2bf62d21fcbb1d373, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:20.878354 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:20.996100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1417/2792] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:20 2022] PUT /identity/v3/projects/5adb6413856249848547501686316214/users/7d0e996b82474ae2bf62d21fcbb1d373/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:21.006621 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.006910 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.007187 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.035099 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] MFA Rules not processed for user `7d0e996b82474ae2bf62d21fcbb1d373`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:21.041752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:21.108272 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1376/2793] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:31:21.112862 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.177395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d7fb1-c690-496e-b182-dc6903e3be08 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:21.182172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:21.182844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.183127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.183407 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.184144 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:21.186053 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:21.283346 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1418/2794] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:21 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:21.287475 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.299361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658aed-19a6-4b85-bb57-bb13d5a71348 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:21.365423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:21.366132 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.366415 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.366687 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.367406 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:21.369323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:21.505042 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1377/2795] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:21 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:31:21.509658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.520250 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c098d33-d75f-4531-a46c-5585ac55eb9a admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:21.524908 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:21.525711 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.525934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.526246 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.530861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:21.530861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:21.540641 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1419/2796] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:21.544823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.555697 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5744-febc-4016-af21-44bdf8be9a5d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:21.564230 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:21.565150 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.565429 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.565707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] PATH_INFO: `/v3/projects/b4edef50f47d41259cd05fa547687108/users/aac61dc539cb4b5692c1ae1f495f3c05/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.581757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4edef50f47d41259cd05fa547687108, user_id=aac61dc539cb4b5692c1ae1f495f3c05, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:21.584585 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:21.681489 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1378/2797] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:21 2022] PUT /identity/v3/projects/b4edef50f47d41259cd05fa547687108/users/aac61dc539cb4b5692c1ae1f495f3c05/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:21.689751 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.700350 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cc769-c933-496c-9d22-0fe8be3e8e68 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:21.765145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8348de-c8f9-4481-b9cf-8b5cd0b73ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:21.765881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8348de-c8f9-4481-b9cf-8b5cd0b73ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.766211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8348de-c8f9-4481-b9cf-8b5cd0b73ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.766492 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8348de-c8f9-4481-b9cf-8b5cd0b73ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.767334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8348de-c8f9-4481-b9cf-8b5cd0b73ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:21.768941 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8348de-c8f9-4481-b9cf-8b5cd0b73ac6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:21.779270 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1420/2798] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:21.784055 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.794721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa601-65c3-4442-9357-19d23592c06f admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:21.800124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:21.801022 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.801322 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.801658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] PATH_INFO: `/v3/projects/b4edef50f47d41259cd05fa547687108/users/aac61dc539cb4b5692c1ae1f495f3c05/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.803978 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4edef50f47d41259cd05fa547687108, user_id=aac61dc539cb4b5692c1ae1f495f3c05, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:21.806664 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:21.818189 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1379/2799] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:21 2022] PUT /identity/v3/projects/b4edef50f47d41259cd05fa547687108/users/aac61dc539cb4b5692c1ae1f495f3c05/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:21.830195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:21.830481 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:21.830760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:21.857982 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] MFA Rules not processed for user `aac61dc539cb4b5692c1ae1f495f3c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:21.859255 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:21.927480 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1421/2800] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:21.939600 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:21.941268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:22.000658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d325c3-2929-4cc5-b7f0-eeda97f82aeb admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:22.004153 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:22.004801 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:22.005080 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:22.005350 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:22.015276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:22.017397 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:22.028112 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1380/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:23.124993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:23.135912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aeb05-4230-435d-b9e1-3ff71f0b06fa None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:23.140529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac61dc539cb4b5692c1ae1f495f3c05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4edef50f47d41259cd05fa547687108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:23.141822 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:23.142233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:23.142521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:23.143253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:23.143569 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:23.145161 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:23.157311 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1422/2802] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:23.169452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:23.179029 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15072e43-531e-440b-89eb-12b0b0e7a0e6 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:23.183610 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac61dc539cb4b5692c1ae1f495f3c05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4edef50f47d41259cd05fa547687108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:23.184266 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:23.184550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:23.184828 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:23.185517 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:23.187436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:23.311401 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1381/2803] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:23 2022] POST /identity/v3/projects => generated 353 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:23.315966 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:23.327510 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ee59a-2006-445b-9043-3a6004e8c836 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:23.381899 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac61dc539cb4b5692c1ae1f495f3c05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4edef50f47d41259cd05fa547687108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:23.382861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:23.383148 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:23.383430 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:23.384211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:23.384520 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:23.386168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:23.401615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1423/2804] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:23.436992 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:23.448525 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2be0f-78b4-43ee-ba49-1228ca0597cf tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:23.453353 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac61dc539cb4b5692c1ae1f495f3c05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4edef50f47d41259cd05fa547687108', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:23.454584 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:23.454870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:23.455146 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] PATH_INFO: `/v3/projects/dbde8a4f0cab41958cb720b6d0683d48` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:23.456762 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dbde8a4f0cab41958cb720b6d0683d48)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:23.458694 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:23.601869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbde8a4f0cab41958cb720b6d0683d48', 'request_id': 'req-8686786f-99ea-4551-96d6-745a6300a039'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:23.607501 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbde8a4f0cab41958cb720b6d0683d48', 'request_id': 'req-8686786f-99ea-4551-96d6-745a6300a039'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:23.681368 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbde8a4f0cab41958cb720b6d0683d48', 'request_id': 'req-8686786f-99ea-4551-96d6-745a6300a039'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:23.693760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] The token cache is being invalidate because project dbde8a4f0cab41958cb720b6d0683d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:23.694047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:23.694842 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-8686786f-99ea-4551-96d6-745a6300a039 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:23.696472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1382/2805] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:23 2022] DELETE /identity/v3/projects/dbde8a4f0cab41958cb720b6d0683d48 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:24.341881 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:24.343968 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:24.415583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4011-a28b-4d78-81df-9b6d075ff157 tempest-VolumeQuotaClassesTest-889535270 tempest-VolumeQuotaClassesTest-889535270-project-admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:24.478570 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:24.479463 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:24.479748 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:24.480060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] PATH_INFO: `/v3/users/7d0e996b82474ae2bf62d21fcbb1d373` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:24.481285 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0e996b82474ae2bf62d21fcbb1d373)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:24.483253 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:24.649459 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0e996b82474ae2bf62d21fcbb1d373'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:24.726058 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0e996b82474ae2bf62d21fcbb1d373'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:24.736223 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0e996b82474ae2bf62d21fcbb1d373'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:24.748439 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0e996b82474ae2bf62d21fcbb1d373'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:24.749190 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0e996b82474ae2bf62d21fcbb1d373'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:24.756205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1424/2806] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:24 2022] DELETE /identity/v3/users/7d0e996b82474ae2bf62d21fcbb1d373 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:24.763034 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:24.763547 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:24.763659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:24.781843 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:24.786929 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:24.842845 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1383/2807] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:24.852750 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:24.854258 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:24.914658 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacdd6a-d14a-496b-be5d-24030bc784d6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:24.918454 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:24.919136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:24.919418 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:24.919691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:24.929625 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:24.931131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:24.942140 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1425/2808] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:25.380936 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:25.382771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:25.401188 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6a34-0a48-4116-8258-66e6ceba29d4 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:25.407399 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:25.408324 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:25.408827 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:25.409118 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] PATH_INFO: `/v3/projects/5adb6413856249848547501686316214` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:25.410745 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adb6413856249848547501686316214)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:25.412774 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:25.550752 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adb6413856249848547501686316214', 'request_id': 'req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:25.556165 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adb6413856249848547501686316214', 'request_id': 'req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:25.784354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adb6413856249848547501686316214', 'request_id': 'req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:25.795469 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] The token cache is being invalidate because project 5adb6413856249848547501686316214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:25.795755 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:25.796373 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:25.798612 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1384/2809] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:25 2022] DELETE /identity/v3/projects/5adb6413856249848547501686316214 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:25.826796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:25.826796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc99a2-32ac-4289-abe1-cab0fa0b4087 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:25.868131 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:25.869093 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:25.869292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:25.869534 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] PATH_INFO: `/v3/users/aac61dc539cb4b5692c1ae1f495f3c05` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:25.870763 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac61dc539cb4b5692c1ae1f495f3c05)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:25.872651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:26.111518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac61dc539cb4b5692c1ae1f495f3c05'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.206055 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac61dc539cb4b5692c1ae1f495f3c05'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.213219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac61dc539cb4b5692c1ae1f495f3c05'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.225330 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac61dc539cb4b5692c1ae1f495f3c05'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.225959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-d94a69fe-13a3-482f-a768-d8edd6e19a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac61dc539cb4b5692c1ae1f495f3c05'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.231703 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1426/2810] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:25 2022] DELETE /identity/v3/users/aac61dc539cb4b5692c1ae1f495f3c05 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:31:26.705301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:26.707575 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:26.720771 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073b32-2cf0-4cb3-8211-8cdb8e48180b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:26.780838 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:26.781802 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:26.782218 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:26.786609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] PATH_INFO: `/v3/projects/b4edef50f47d41259cd05fa547687108` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:26.786609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4edef50f47d41259cd05fa547687108)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:26.786609 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:26.899059 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4edef50f47d41259cd05fa547687108', 'request_id': 'req-969d22ce-5e43-413e-9f52-1bcae6b8d75d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.904329 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4edef50f47d41259cd05fa547687108', 'request_id': 'req-969d22ce-5e43-413e-9f52-1bcae6b8d75d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:26.995162 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4edef50f47d41259cd05fa547687108', 'request_id': 'req-969d22ce-5e43-413e-9f52-1bcae6b8d75d'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:27.008270 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] The token cache is being invalidate because project b4edef50f47d41259cd05fa547687108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80227) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:27.008589 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:27.009198 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-969d22ce-5e43-413e-9f52-1bcae6b8d75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:27.010890 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1385/2811] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:26 2022] DELETE /identity/v3/projects/b4edef50f47d41259cd05fa547687108 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:27.017347 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.018196 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.018387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.039532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:27.040764 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:27.102013 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1427/2812] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:27.110644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.110935 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.111433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.131500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:27.132985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:27.141285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1386/2813] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:27.145852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.156159 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faadc5-f369-46c8-a65e-4821dbd2e7cc None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.160959 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.161626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.161911 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.162229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.162967 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:27.163274 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.164871 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:27.177280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1428/2814] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:27.181781 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.192577 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627cd79-8877-445c-a757-0eba4a88c4fc None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.197391 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.198058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.198377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.198659 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.199390 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.201318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:27.345199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1387/2815] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:27 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:27.349634 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.360583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27f6e-3860-4bcf-981a-237b757027d6 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.426976 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.427733 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.428018 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.428296 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.428995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.430988 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:27.544372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1429/2816] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:27 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:27.548510 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.560377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432027d0-79d8-439d-8555-a8f18d03338d admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.565377 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.566052 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.566369 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.566646 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.567381 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.569000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:27.580858 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1388/2817] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:27.585004 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.595823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6710673-397d-42dd-8aa4-2aa204093a33 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.600757 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d7d68-16d0-4aab-9389-0d5a8438578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.601438 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7d68-16d0-4aab-9389-0d5a8438578f admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.601736 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7d68-16d0-4aab-9389-0d5a8438578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.602023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d7d68-16d0-4aab-9389-0d5a8438578f admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.602807 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7d68-16d0-4aab-9389-0d5a8438578f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.604440 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d7d68-16d0-4aab-9389-0d5a8438578f admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:27.616220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1430/2818] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:27.620343 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.630656 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17955e74-2903-4bf8-bdb5-61552878bf2b admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.635829 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.636751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.637031 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.637308 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] PATH_INFO: `/v3/projects/d65076c93a81477ebe0f2a2e31703faf/users/d4864555327d4202972a57ec4c56a7ab/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.652605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65076c93a81477ebe0f2a2e31703faf, user_id=d4864555327d4202972a57ec4c56a7ab, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.655294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:27.761722 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1389/2819] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:27 2022] PUT /identity/v3/projects/d65076c93a81477ebe0f2a2e31703faf/users/d4864555327d4202972a57ec4c56a7ab/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:27.773598 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.777455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.777455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.805550 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] MFA Rules not processed for user `d4864555327d4202972a57ec4c56a7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:27.806811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:27.875962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1431/2820] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:27.880839 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:27.964375 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8accd-38f4-4859-85a3-3e2edd2ba820 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:27.970061 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:27.970799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:27.971085 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:27.971361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:27.972084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:27.974143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.110945 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1390/2821] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:27 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:31:28.115334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.126360 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b356194-87a6-40a6-acca-a0e4b3b5d999 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.183891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.184597 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.184910 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.185208 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.185912 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:28.188521 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.294007 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1432/2822] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:28 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:28.299149 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.309407 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2bc36-477e-4564-a487-5d138bac4f35 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.314633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.315303 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.315587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.315863 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.316592 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:28.318214 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.329841 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1391/2823] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:31:28.333951 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.345992 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7845-d6db-40bd-b012-d101e03f508d admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.350786 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309c9b5-c5f0-425b-b025-0f442adfbdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.351455 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309c9b5-c5f0-425b-b025-0f442adfbdee admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.351739 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309c9b5-c5f0-425b-b025-0f442adfbdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.352017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309c9b5-c5f0-425b-b025-0f442adfbdee admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.352775 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309c9b5-c5f0-425b-b025-0f442adfbdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:28.355145 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309c9b5-c5f0-425b-b025-0f442adfbdee admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.364875 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1433/2824] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:28.369173 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.380530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2671b0b-dd20-4916-96e9-555d4b3de1bd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.385763 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.387509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.387509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.387509 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] PATH_INFO: `/v3/projects/9ec9204987c74e6680cdcdc91dcabae4/users/a6ef9fcb27d9436296f71d5dc9aef5b4/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.403450 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec9204987c74e6680cdcdc91dcabae4, user_id=a6ef9fcb27d9436296f71d5dc9aef5b4, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:28.406252 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.492355 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1392/2825] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:28 2022] PUT /identity/v3/projects/9ec9204987c74e6680cdcdc91dcabae4/users/a6ef9fcb27d9436296f71d5dc9aef5b4/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:28.557707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.558023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.558334 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.588132 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] MFA Rules not processed for user `a6ef9fcb27d9436296f71d5dc9aef5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:28.589409 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:28.654851 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1434/2826] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:28.659531 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.721943 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a04db-c83a-4e82-9b0c-be94f1eab9cf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.726658 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.727319 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.727601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.727894 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.728593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:28.730686 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.820023 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1393/2827] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:28 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:28.824204 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.835187 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae387690-2834-4931-acad-085a4c1fd0eb None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.894009 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.894762 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.895045 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.895323 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] PATH_INFO: `/v3/users` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:28.896168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:28.898134 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:28.978277 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1435/2828] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:28 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:28.982423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:28.993808 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ea6dc-4291-4357-85a7-c1e82b6760f9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:28.998464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:28.999126 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:28.999454 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:28.999728 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.000633 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:29.002306 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:29.013578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1394/2829] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:31:29.017690 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:29.027798 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a242df1-ff75-490a-b9e0-372712d193ea admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:29.033467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:29.034413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:29.034691 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:29.034958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] PATH_INFO: `/v3/projects/ab24c269a82b43e7be579f0d7d1fbb7e/users/e3d42ad33d684494904c8ac1e76a1271/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.051648 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab24c269a82b43e7be579f0d7d1fbb7e, user_id=e3d42ad33d684494904c8ac1e76a1271, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:29.054445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:29.172335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1436/2830] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:29 2022] PUT /identity/v3/projects/ab24c269a82b43e7be579f0d7d1fbb7e/users/e3d42ad33d684494904c8ac1e76a1271/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:29.176348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:29.186097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f22aac-7a3e-4606-bcb3-bdb13629bb17 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:29.241246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd50a33-db69-496d-b5bc-f6fa45e790a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:29.241833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd50a33-db69-496d-b5bc-f6fa45e790a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:29.242138 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd50a33-db69-496d-b5bc-f6fa45e790a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:29.242452 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd50a33-db69-496d-b5bc-f6fa45e790a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.243166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd50a33-db69-496d-b5bc-f6fa45e790a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:29.244773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd50a33-db69-496d-b5bc-f6fa45e790a2 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:29.255156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1395/2831] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:29.259697 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:29.270495 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1435-56af-427a-9919-b4473dd57dfc admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:29.275233 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:29.276101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:29.276381 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:29.276650 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] PATH_INFO: `/v3/projects/ab24c269a82b43e7be579f0d7d1fbb7e/users/e3d42ad33d684494904c8ac1e76a1271/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.278622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab24c269a82b43e7be579f0d7d1fbb7e, user_id=e3d42ad33d684494904c8ac1e76a1271, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:29.281215 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:29.291017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1437/2832] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:29 2022] PUT /identity/v3/projects/ab24c269a82b43e7be579f0d7d1fbb7e/users/e3d42ad33d684494904c8ac1e76a1271/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:31:29.301301 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:29.301591 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:29.301869 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.327695 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] MFA Rules not processed for user `e3d42ad33d684494904c8ac1e76a1271`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:29.329032 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:29.395605 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1396/2833] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:29.407238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:29.408902 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:29.465264 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d37ba6-6c08-4c20-a55b-892f6d094579 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:29.468962 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:29.469722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:29.470017 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:29.470336 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.479268 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:29.480722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:29.491352 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1438/2834] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:29.707902 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:29.709298 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:29.721629 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb8f1a-45a6-458c-be29-a0993f4514e2 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:29.725414 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:29.726054 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:29.726359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:29.726634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:29.783111 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:29.785545 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:29.794796 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1397/2835] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:34.035518 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:34.037266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:34.071464 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:34.129564 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1b7e-7a5b-4a42-9892-b1f834232972 service cinder] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:34.135995 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:34.136316 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d18e-5125-46bc-9f34-44c0112ff027 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:34.136646 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:34.136924 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:34.137199 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:34.138993 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:34.140766 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:34.141624 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:34.141903 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:34.142208 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] PATH_INFO: `/v3/users/d4864555327d4202972a57ec4c56a7ab` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:34.144069 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4864555327d4202972a57ec4c56a7ab)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:34.145972 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:34.150994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:34.152529 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b7a5-cdb0-4cbd-8727-05f1e2069c71 service placement] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:34.162914 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1439/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:34.375288 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4864555327d4202972a57ec4c56a7ab'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:34.376039 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4864555327d4202972a57ec4c56a7ab'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:34.384439 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4864555327d4202972a57ec4c56a7ab'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:34.398277 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4864555327d4202972a57ec4c56a7ab'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:34.399005 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4864555327d4202972a57ec4c56a7ab'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:34.492955 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1398/2837] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:34 2022] DELETE /identity/v3/users/d4864555327d4202972a57ec4c56a7ab => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:34.497652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:34.497938 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:34.498251 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:34.515651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:34.516826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:34.572934 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1440/2838] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:34.582918 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:34.584338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:34.639709 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a34ff3-27c1-4341-9d3d-57fbec7a2caa admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:34.643251 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:34.643966 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:34.644248 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:34.644521 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:34.653437 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:34.654991 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:34.664243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1399/2839] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:35.087928 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:35.089422 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:35.102060 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a21d3-7a0f-4a07-8911-8e7e2501dc37 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:35.106621 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:35.107543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:35.107826 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:35.108098 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] PATH_INFO: `/v3/projects/d65076c93a81477ebe0f2a2e31703faf` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:35.109292 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65076c93a81477ebe0f2a2e31703faf)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:35.111219 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:35.234470 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65076c93a81477ebe0f2a2e31703faf', 'request_id': 'req-c662a97f-5411-4684-8f33-1e6d20bc3283'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.240575 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65076c93a81477ebe0f2a2e31703faf', 'request_id': 'req-c662a97f-5411-4684-8f33-1e6d20bc3283'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.355023 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65076c93a81477ebe0f2a2e31703faf', 'request_id': 'req-c662a97f-5411-4684-8f33-1e6d20bc3283'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.367249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] The token cache is being invalidate because project d65076c93a81477ebe0f2a2e31703faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:35.372997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.372997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.372997 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1441/2840] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:35 2022] DELETE /identity/v3/projects/d65076c93a81477ebe0f2a2e31703faf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:35.373800 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:35.384068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337bdc0-1367-45c0-b697-68b5f6778332 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:35.445897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:35.446767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:35.447047 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:35.447472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] PATH_INFO: `/v3/users/a6ef9fcb27d9436296f71d5dc9aef5b4` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:35.448689 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ef9fcb27d9436296f71d5dc9aef5b4)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:35.450616 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:35.695393 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ef9fcb27d9436296f71d5dc9aef5b4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.696724 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ef9fcb27d9436296f71d5dc9aef5b4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.704823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ef9fcb27d9436296f71d5dc9aef5b4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.719040 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ef9fcb27d9436296f71d5dc9aef5b4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.720292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ef9fcb27d9436296f71d5dc9aef5b4'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:35.829650 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1400/2841] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:35 2022] DELETE /identity/v3/users/a6ef9fcb27d9436296f71d5dc9aef5b4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:36.259958 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:36.261353 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:36.275387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662a97f-5411-4684-8f33-1e6d20bc3283 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:36.341051 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:36.341919 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:36.342232 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:36.342512 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] PATH_INFO: `/v3/projects/9ec9204987c74e6680cdcdc91dcabae4` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:36.343745 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec9204987c74e6680cdcdc91dcabae4)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:36.345651 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:36.463387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec9204987c74e6680cdcdc91dcabae4', 'request_id': 'req-8faaa370-a644-414c-9ace-77975ef9c0fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.468687 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec9204987c74e6680cdcdc91dcabae4', 'request_id': 'req-8faaa370-a644-414c-9ace-77975ef9c0fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.554563 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec9204987c74e6680cdcdc91dcabae4', 'request_id': 'req-8faaa370-a644-414c-9ace-77975ef9c0fd'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.566279 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] The token cache is being invalidate because project 9ec9204987c74e6680cdcdc91dcabae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:36.566586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.567573 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.568815 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1442/2842] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:36 2022] DELETE /identity/v3/projects/9ec9204987c74e6680cdcdc91dcabae4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:36.572985 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:36.574472 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:36.587641 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22154969-ee38-4ce7-a69d-d7b046c166a8 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:36.643873 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:36.644881 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:36.645265 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:36.645835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] PATH_INFO: `/v3/users/e3d42ad33d684494904c8ac1e76a1271` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:36.647647 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d42ad33d684494904c8ac1e76a1271)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:36.649590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:36.854870 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d42ad33d684494904c8ac1e76a1271'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.855433 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d42ad33d684494904c8ac1e76a1271'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.862446 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d42ad33d684494904c8ac1e76a1271'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.873729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d42ad33d684494904c8ac1e76a1271'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.874431 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-150c01a6-5530-477a-a53a-685db751607b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d42ad33d684494904c8ac1e76a1271'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:36.943227 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1401/2843] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:36 2022] DELETE /identity/v3/users/e3d42ad33d684494904c8ac1e76a1271 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:37.431396 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:37.432888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:37.451631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa370-a644-414c-9ace-77975ef9c0fd admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:37.508041 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:37.508909 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:37.509189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:37.509464 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] PATH_INFO: `/v3/projects/ab24c269a82b43e7be579f0d7d1fbb7e` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:37.510730 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab24c269a82b43e7be579f0d7d1fbb7e)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:37.512664 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:37.624319 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab24c269a82b43e7be579f0d7d1fbb7e', 'request_id': 'req-47d41bb5-9b52-49c0-9c52-5019637a6b23'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:37.630367 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab24c269a82b43e7be579f0d7d1fbb7e', 'request_id': 'req-47d41bb5-9b52-49c0-9c52-5019637a6b23'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:37.714548 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab24c269a82b43e7be579f0d7d1fbb7e', 'request_id': 'req-47d41bb5-9b52-49c0-9c52-5019637a6b23'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:37.726172 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] The token cache is being invalidate because project ab24c269a82b43e7be579f0d7d1fbb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:37.726467 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:37.727109 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-47d41bb5-9b52-49c0-9c52-5019637a6b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:37.730229 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1443/2844] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:37 2022] DELETE /identity/v3/projects/ab24c269a82b43e7be579f0d7d1fbb7e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:31:37.734853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:37.735313 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:37.735430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:37.755273 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:37.756474 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:37.813823 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1402/2845] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:37.822712 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:37.823001 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:37.823276 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:37.842059 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:37.843317 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:37.852586 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1444/2846] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:37.857386 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:37.867707 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdee64-d2c3-414a-bbcf-dc9decd66543 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:37.872246 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:37.872900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:37.873184 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:37.873459 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:37.874222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:37.874530 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:37.876116 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:37.888541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1403/2847] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:37.893011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:37.903387 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df54ec-7ace-483c-ad89-bdae08cd6c7d None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:37.908076 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:37.909792 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:37.910130 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:37.910410 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:37.911101 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:37.913016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.013626 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1445/2848] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:37 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:38.017951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.028488 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96782835-3120-4229-bc3d-4739400a9c91 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.084676 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.085357 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.085642 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.085919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.086956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.088860 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.224512 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1404/2849] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:38 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:38.228659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.240141 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068311ec-749d-4827-b338-4aa81f3de905 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.244652 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.245335 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.245615 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.245888 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.246647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.248238 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.259056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1446/2850] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:38.263063 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.274280 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8396d-0337-42cd-9123-ed2098e540dd admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.279757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c7bb9-1033-40a8-b915-68962121643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.279757 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7bb9-1033-40a8-b915-68962121643f admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.280008 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7bb9-1033-40a8-b915-68962121643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.280192 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7bb9-1033-40a8-b915-68962121643f admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.280951 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c7bb9-1033-40a8-b915-68962121643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.282587 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c7bb9-1033-40a8-b915-68962121643f admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.294833 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1405/2851] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:38.299242 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.308980 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef233cf0-fc04-40dd-ace0-e3edcb74e740 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.313488 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.314399 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.314674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.314940 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] PATH_INFO: `/v3/projects/abc293b6d7ae425593d422139f5a86da/users/836780b0fd604f0da8e1c53262d6ef74/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.328885 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc293b6d7ae425593d422139f5a86da, user_id=836780b0fd604f0da8e1c53262d6ef74, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.332168 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.412616 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1447/2852] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:38 2022] PUT /identity/v3/projects/abc293b6d7ae425593d422139f5a86da/users/836780b0fd604f0da8e1c53262d6ef74/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:38.425900 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.426278 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.426500 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.453555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] MFA Rules not processed for user `836780b0fd604f0da8e1c53262d6ef74`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:38.454817 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:38.521923 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1406/2853] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:38.526704 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.586931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51199256-268b-4606-8246-9a21ab4f58a8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.591537 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.592195 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.592473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.592746 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.593428 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.595332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.682984 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1448/2854] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:38 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:38.687243 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.699018 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0787e-88da-424d-a213-4969ec8dc9de None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.756016 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.756693 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.756956 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.757229 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.758216 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.760137 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.852993 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1407/2855] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:38 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:38.856211 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.867633 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb5328-bcc4-4763-947d-5384c103a01e admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.872553 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.873243 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.873524 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.873796 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.874557 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.876143 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:38.888176 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1449/2856] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:38.893438 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:38.903744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b417d0-8588-4bae-ac2c-47f2ca5f73bf admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:38.908507 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:38.909384 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:38.909655 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:38.909926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] PATH_INFO: `/v3/projects/e7e633295ea647cd856ba4c14eebca24/users/40f34040d5584a9380d2f2d2fe962070/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:38.926082 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e633295ea647cd856ba4c14eebca24, user_id=40f34040d5584a9380d2f2d2fe962070, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:38.930013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:39.029395 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1408/2857] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:38 2022] PUT /identity/v3/projects/e7e633295ea647cd856ba4c14eebca24/users/40f34040d5584a9380d2f2d2fe962070/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:39.033611 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:39.043659 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c39db-e7e0-44b8-917a-a0923ba23fa2 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:39.099012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6e363-4860-4712-b4e0-d8c90c6f5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:39.099696 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6e363-4860-4712-b4e0-d8c90c6f5da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:39.099981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6e363-4860-4712-b4e0-d8c90c6f5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:39.100379 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6e363-4860-4712-b4e0-d8c90c6f5da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:39.101146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6e363-4860-4712-b4e0-d8c90c6f5da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:39.102771 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6e363-4860-4712-b4e0-d8c90c6f5da4 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:39.113266 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1450/2858] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:39.117354 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:39.128318 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70160fed-6eda-47ec-876c-2c74a27018ad admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:39.133423 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:39.134333 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:39.134643 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:39.134915 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] PATH_INFO: `/v3/projects/e7e633295ea647cd856ba4c14eebca24/users/40f34040d5584a9380d2f2d2fe962070/roles/278a0b419dab4b198abcf738011cdca6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:39.136897 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e633295ea647cd856ba4c14eebca24, user_id=40f34040d5584a9380d2f2d2fe962070, role_id=278a0b419dab4b198abcf738011cdca6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:39.139578 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:39.149779 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1409/2859] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:39 2022] PUT /identity/v3/projects/e7e633295ea647cd856ba4c14eebca24/users/40f34040d5584a9380d2f2d2fe962070/roles/278a0b419dab4b198abcf738011cdca6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:39.160154 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:39.160446 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:39.160728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:39.186532 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] MFA Rules not processed for user `40f34040d5584a9380d2f2d2fe962070`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:39.187728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:39.253846 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1451/2860] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:39.265746 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:39.267430 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:39.324098 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204a25-c233-4f79-86f9-6186b4877063 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:39.327718 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:39.328361 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:39.328639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:39.328909 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:39.338619 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:39.340058 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:39.352799 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1410/2861] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:39.504363 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:39.514249 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1437cb-c95c-4b40-9d3f-4c11b8f6980f None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:39.518281 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02897a0-4a74-4560-9c07-64347f6cead3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:39.518949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02897a0-4a74-4560-9c07-64347f6cead3 service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:39.519228 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02897a0-4a74-4560-9c07-64347f6cead3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:39.519517 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02897a0-4a74-4560-9c07-64347f6cead3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:39.576095 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02897a0-4a74-4560-9c07-64347f6cead3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:39.577525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02897a0-4a74-4560-9c07-64347f6cead3 service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:39.586489 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1452/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:40.073371 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:40.134096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178074-03f9-445f-ad80-454a3d3310b6 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:40.138601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:40.139455 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:40.139733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:40.140004 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] PATH_INFO: `/v3/users/836780b0fd604f0da8e1c53262d6ef74` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:40.141176 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=836780b0fd604f0da8e1c53262d6ef74)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:40.143180 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:40.361986 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836780b0fd604f0da8e1c53262d6ef74'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:40.362715 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836780b0fd604f0da8e1c53262d6ef74'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:40.369721 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836780b0fd604f0da8e1c53262d6ef74'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:40.382639 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836780b0fd604f0da8e1c53262d6ef74'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:40.383492 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836780b0fd604f0da8e1c53262d6ef74'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:40.464097 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1411/2863] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:40 2022] DELETE /identity/v3/users/836780b0fd604f0da8e1c53262d6ef74 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:40.468719 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:40.469011 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:40.469294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:40.486722 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:40.488413 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:40.544708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1453/2864] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:40.555131 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:40.556528 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:40.611076 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d4e95-a525-4576-8914-56c06872eb6e admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:40.615499 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:40.616151 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:40.616436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:40.616712 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:40.625613 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:40.627070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:40.637244 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1412/2865] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:41.065100 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:41.067169 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:41.079316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828bcda-3e36-4144-9198-d7e18a307d52 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:41.084450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:41.085445 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:41.085728 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:41.086003 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] PATH_INFO: `/v3/projects/abc293b6d7ae425593d422139f5a86da` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:41.087252 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc293b6d7ae425593d422139f5a86da)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:41.089147 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:41.228244 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc293b6d7ae425593d422139f5a86da', 'request_id': 'req-af0a03dd-7fe3-46bc-a44f-5f853df06293'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.233760 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc293b6d7ae425593d422139f5a86da', 'request_id': 'req-af0a03dd-7fe3-46bc-a44f-5f853df06293'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.320146 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc293b6d7ae425593d422139f5a86da', 'request_id': 'req-af0a03dd-7fe3-46bc-a44f-5f853df06293'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.331338 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] The token cache is being invalidate because project abc293b6d7ae425593d422139f5a86da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:41.331622 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.332261 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.333811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1454/2866] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:41 2022] DELETE /identity/v3/projects/abc293b6d7ae425593d422139f5a86da => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:41.337997 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:41.348404 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6703f46-7aa4-477b-80ff-ed4466d74f78 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:41.404140 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:41.405013 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:41.405294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:41.405568 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] PATH_INFO: `/v3/users/40f34040d5584a9380d2f2d2fe962070` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:41.406788 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f34040d5584a9380d2f2d2fe962070)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:41.408691 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:41.552848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f34040d5584a9380d2f2d2fe962070'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.553524 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f34040d5584a9380d2f2d2fe962070'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.560359 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f34040d5584a9380d2f2d2fe962070'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.571959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f34040d5584a9380d2f2d2fe962070'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.572582 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-2654e0e1-2406-4e73-b9e3-f8114bdfdaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f34040d5584a9380d2f2d2fe962070'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:41.640205 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1413/2867] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:41 2022] DELETE /identity/v3/users/40f34040d5584a9380d2f2d2fe962070 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:42.076316 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.077843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:42.092077 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a03dd-7fe3-46bc-a44f-5f853df06293 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.149344 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.150236 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.150516 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.150793 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] PATH_INFO: `/v3/projects/e7e633295ea647cd856ba4c14eebca24` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.151971 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e633295ea647cd856ba4c14eebca24)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.153839 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.250639 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e633295ea647cd856ba4c14eebca24', 'request_id': 'req-1610b966-1a9a-4e34-ab5f-5c18f42729f9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:42.256450 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e633295ea647cd856ba4c14eebca24', 'request_id': 'req-1610b966-1a9a-4e34-ab5f-5c18f42729f9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:42.326269 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e633295ea647cd856ba4c14eebca24', 'request_id': 'req-1610b966-1a9a-4e34-ab5f-5c18f42729f9'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:42.338460 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] The token cache is being invalidate because project e7e633295ea647cd856ba4c14eebca24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:42.338742 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:42.339395 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-1610b966-1a9a-4e34-ab5f-5c18f42729f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:42.340970 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1455/2868] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:42 2022] DELETE /identity/v3/projects/e7e633295ea647cd856ba4c14eebca24 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:42.345977 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.346634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.346634 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.370811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:42.370811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:42.426623 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1414/2869] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:42.435844 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba144-5202-4331-ac22-76520e488379 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.436136 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba144-5202-4331-ac22-76520e488379 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.436420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba144-5202-4331-ac22-76520e488379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.454729 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-cafba144-5202-4331-ac22-76520e488379 None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:42.456414 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-cafba144-5202-4331-ac22-76520e488379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:42.464366 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1456/2870] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:42.468795 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.479541 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1265f-26f1-45e7-b2f8-6329664919a3 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.484174 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.484835 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.485110 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.485380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.486136 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80227) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:31:42.486434 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.488285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.499995 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1415/2871] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Apr 11 13:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:31:42.504583 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafba144-5202-4331-ac22-76520e488379 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.513892 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafba144-5202-4331-ac22-76520e488379 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.518981 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.519629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.519907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.520180 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.520863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.522933 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.613543 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1457/2872] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Apr 11 13:31:42 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:31:42.617729 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.630811 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566cd31-d9ec-4380-b88e-97cd405c56f9 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.688073 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.688744 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.689024 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.689296 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.690124 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.692100 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.755048 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1416/2873] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Apr 11 13:31:42 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:31:42.759461 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.770552 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2b93-a0fa-469e-9314-b749b3c9a1e8 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.775192 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.775848 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.776129 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.776403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.777142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.778769 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.790515 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1458/2874] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:31:42.797380 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.808199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced95f-318b-42a9-9523-3762aadb0bf4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.813233 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f5c6-92db-4178-98fe-2f88c007b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.813892 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f5c6-92db-4178-98fe-2f88c007b368 admin admin] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.814207 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f5c6-92db-4178-98fe-2f88c007b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.814482 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f5c6-92db-4178-98fe-2f88c007b368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.815772 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f5c6-92db-4178-98fe-2f88c007b368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.817276 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f5c6-92db-4178-98fe-2f88c007b368 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.827328 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1417/2875] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Apr 11 13:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:31:42.832325 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:42.842462 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0be7-b302-4d5b-a3e0-ab0a9fc828d0 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:42.847332 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:42.848205 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.848493 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.848787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] PATH_INFO: `/v3/projects/0f1899fe4c2541cbb012dbf7e0a0f6c4/users/7ac51ae68c43437fa7deb390d9d8e9d6/roles/7f61ee9da37149509268e80d31dea384` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.864283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1899fe4c2541cbb012dbf7e0a0f6c4, user_id=7ac51ae68c43437fa7deb390d9d8e9d6, role_id=7f61ee9da37149509268e80d31dea384)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:42.866987 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:42.961239 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1459/2876] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Apr 11 13:31:42 2022] PUT /identity/v3/projects/0f1899fe4c2541cbb012dbf7e0a0f6c4/users/7ac51ae68c43437fa7deb390d9d8e9d6/roles/7f61ee9da37149509268e80d31dea384 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:31:42.971505 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c75262-d686-4578-b461-70538df9b873 None None] REQUEST_METHOD: `POST` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:42.971848 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c75262-d686-4578-b461-70538df9b873 None None] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:42.972068 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c75262-d686-4578-b461-70538df9b873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:42.997663 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.auth.core [None req-c8c75262-d686-4578-b461-70538df9b873 None None] MFA Rules not processed for user `7ac51ae68c43437fa7deb390d9d8e9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80227) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:42.998926 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-c8c75262-d686-4578-b461-70538df9b873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:43.062012 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1418/2877] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:43.073631 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:43.075473 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:43.130949 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6af97-80bd-4aa3-8cee-79803d25e4c3 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:43.135054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0e26d-88c9-4234-86a5-3bc9f65f48aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:43.135761 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0e26d-88c9-4234-86a5-3bc9f65f48aa service cinder] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:43.136002 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0e26d-88c9-4234-86a5-3bc9f65f48aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:43.136280 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0e26d-88c9-4234-86a5-3bc9f65f48aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:43.145656 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0e26d-88c9-4234-86a5-3bc9f65f48aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:43.147099 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0e26d-88c9-4234-86a5-3bc9f65f48aa service cinder] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:43.155816 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1460/2878] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:43.182161 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c75262-d686-4578-b461-70538df9b873 None None] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:43.248156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c75262-d686-4578-b461-70538df9b873 None None] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:43.253338 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:43.254317 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:43.254601 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:43.254875 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] PATH_INFO: `/v3/users/7ac51ae68c43437fa7deb390d9d8e9d6` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:43.256096 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac51ae68c43437fa7deb390d9d8e9d6)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:43.258336 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:43.464868 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac51ae68c43437fa7deb390d9d8e9d6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:43.465534 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac51ae68c43437fa7deb390d9d8e9d6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:43.472937 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac51ae68c43437fa7deb390d9d8e9d6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:43.484550 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac51ae68c43437fa7deb390d9d8e9d6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:43.485249 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac51ae68c43437fa7deb390d9d8e9d6'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:43.577220 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1419/2879] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:31:43 2022] DELETE /identity/v3/users/7ac51ae68c43437fa7deb390d9d8e9d6 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:31:43.582240 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:43.582531 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:43.582811 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:43.599990 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] MFA Rules not processed for user `3c006c2d55954e5a934e999f787f885f`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:31:43.601189 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:43.659752 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1461/2880] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:31:43.669818 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:43.671275 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:43.729130 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be9c07-2380-476c-8e27-ad27b19e61c4 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:43.732702 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:43.733342 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:43.733618 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:43.733889 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:43.745036 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:43.749037 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:43.756340 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1420/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:31:44.219122 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:31:44.220694 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:31:44.234692 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b944c7-81aa-4b28-93e6-662989fc12ce None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:31:44.239931 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:31:44.240840 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:31:44.241127 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:31:44.241401 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] PATH_INFO: `/v3/projects/0f1899fe4c2541cbb012dbf7e0a0f6c4` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:31:44.242861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1899fe4c2541cbb012dbf7e0a0f6c4)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:31:44.244907 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:31:44.354429 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1899fe4c2541cbb012dbf7e0a0f6c4', 'request_id': 'req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:44.359647 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1899fe4c2541cbb012dbf7e0a0f6c4', 'request_id': 'req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:44.429384 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1899fe4c2541cbb012dbf7e0a0f6c4', 'request_id': 'req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:44.441699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] The token cache is being invalidate because project 0f1899fe4c2541cbb012dbf7e0a0f6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:31:44.442012 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:44.442699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-efb7e3b2-1173-48eb-8fc4-ad9feffb3012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:31:44.444359 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1462/2882] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:31:44 2022] DELETE /identity/v3/projects/0f1899fe4c2541cbb012dbf7e0a0f6c4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:32:13.056705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:32:13.058088 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:32:13.114760 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5bc5b-4109-4e5d-9f83-07e7f796c670 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:32:13.162070 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd82c17696d4a258748cc70ebc8569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:32:13.162733 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:32:13.163014 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:32:13.163285 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:32:13.165199 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:32:13.222743 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:32:13.224170 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:32:13.233311 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1421/2883] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:32:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:32:22.818283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] REQUEST_METHOD: `POST` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:32:22.818863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:32:22.818863 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:32:22.836623 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.auth.core [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] MFA Rules not processed for user `ea45e26ac8bf48028714037a5582712b`. Rule list: `[]` (Enabled: `True`). {{(pid=80226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:32:22.837814 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:32:22.844674 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1463/2884] 10.222.0.49 () {58 vars in 957 bytes} [Mon Apr 11 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:32:23.167222 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:32:23.168716 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:32:23.229919 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b2d1-b020-4cef-ace4-aab594cfc504 service cinder] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:32:23.235284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:32:23.235284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:32:23.235284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:32:23.235284 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:32:23.236526 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:32:23.246451 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:32:23.247877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:32:23.256166 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1422/2885] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:32:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:34:23.847351 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:23.848937 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:23.958744 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb88521-2fdb-4610-bf54-a6862d7e98a2 None None] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:23.964707 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02c83e7079e45e7b8ae4b49ac15f4d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:23.965540 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:23.965823 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:23.966097 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:23.968843 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:23.982054 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:23.984468 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:23.996412 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1464/2886] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:34:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:34:24.068705 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:24.070293 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:24.084580 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07b098-91b9-4d2f-aa15-b5ff735e0fbd service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:24.091000 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:24.091765 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:24.092292 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:24.092959 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:24.094914 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:24.105644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:24.109491 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:24.116798 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1423/2887] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:34:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:34:24.326458 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:24.337283 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5532758-0dc0-471a-a169-6823544df14b service nova] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:24.341016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:24.341671 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:24.342008 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:24.342403 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:24.344265 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:24.363064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:24.363064 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:24.372320 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1465/2888] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:34:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:34:25.556387 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:25.565983 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0554f5f-20d7-4e2a-abad-065273ef3518 service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:25.575497 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:25.576197 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:25.576590 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:25.577366 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:25.579152 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:25.593974 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:25.595447 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:25.607607 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1424/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:34:39.858994 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:39.867602 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4698-a3df-4ca8-afed-1eeb74fc3730 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:39.871220 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f59d1deb46094936b5572bb6c5aa2f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:39.871861 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] REQUEST_METHOD: `GET` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:39.872142 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:39.872416 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:39.875088 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:39.937834 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:39.939305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:39.949015 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1466/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:34:47.439163 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:47.440939 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:47.456263 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b464-f68c-462f-a219-802d77a00d6a service neutron] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:47.461074 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:47.461969 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:47.462294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:47.462595 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] PATH_INFO: `/v3/users/ea45e26ac8bf48028714037a5582712b` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:47.463853 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea45e26ac8bf48028714037a5582712b)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:47.465773 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:47.639751 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea45e26ac8bf48028714037a5582712b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:47.640555 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea45e26ac8bf48028714037a5582712b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:47.647268 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea45e26ac8bf48028714037a5582712b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:47.659294 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea45e26ac8bf48028714037a5582712b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:47.660084 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea45e26ac8bf48028714037a5582712b'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:47.719448 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1425/2891] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:34:47 2022] DELETE /identity/v3/users/ea45e26ac8bf48028714037a5582712b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:34:47.953699 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:47.963638 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5ead-7078-4cca-bb75-19433edc2184 service neutron] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:48.024339 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:48.025235 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:48.025513 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:48.025787 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] PATH_INFO: `/v3/projects/31c04750f0ea4e5a87fdbde19c5b91a5` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:48.027016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c04750f0ea4e5a87fdbde19c5b91a5)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:48.028891 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:48.156873 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c04750f0ea4e5a87fdbde19c5b91a5', 'request_id': 'req-44120d2f-2949-458a-9e72-1d5cad88b582'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.162178 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c04750f0ea4e5a87fdbde19c5b91a5', 'request_id': 'req-44120d2f-2949-458a-9e72-1d5cad88b582'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.247294 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c04750f0ea4e5a87fdbde19c5b91a5', 'request_id': 'req-44120d2f-2949-458a-9e72-1d5cad88b582'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.258935 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] The token cache is being invalidate because project 31c04750f0ea4e5a87fdbde19c5b91a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:34:48.259471 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.260203 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.261708 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1467/2892] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:34:47 2022] DELETE /identity/v3/projects/31c04750f0ea4e5a87fdbde19c5b91a5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:34:48.266946 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:48.268412 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:48.282323 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd061-5bf5-4111-88a3-fc0fadce0d64 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:48.336980 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:48.337851 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:48.338156 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:48.338436 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] PATH_INFO: `/v3/users/29f78c7e87df4253931031542403a10c` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:48.339636 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f78c7e87df4253931031542403a10c)` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:48.342143 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:48.556411 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f78c7e87df4253931031542403a10c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.557086 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f78c7e87df4253931031542403a10c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.565114 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f78c7e87df4253931031542403a10c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.584981 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f78c7e87df4253931031542403a10c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.585767 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.notifications [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f78c7e87df4253931031542403a10c'} {{(pid=80227) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:48.677825 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1426/2893] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Apr 11 13:34:48 2022] DELETE /identity/v3/users/29f78c7e87df4253931031542403a10c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:34:49.051525 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Authenticating user token {{(pid=80226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:34:49.053115 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.fernet_utils [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:34:49.069102 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44120d2f-2949-458a-9e72-1d5cad88b582 admin admin] Validating token access rules against request {{(pid=80226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:34:49.135420 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c006c2d55954e5a934e999f787f885f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a113afb28034953938db4779ef8e6eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:34:49.136295 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:34:49.136576 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:34:49.136852 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] PATH_INFO: `/v3/projects/ab0d4cda468842aaa5f71f9c33f393d6` {{(pid=80226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:34:49.138056 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0d4cda468842aaa5f71f9c33f393d6)` {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:34:49.140016 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] RBAC: Authorization granted {{(pid=80226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:34:49.267082 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0d4cda468842aaa5f71f9c33f393d6', 'request_id': 'req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:49.273372 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0d4cda468842aaa5f71f9c33f393d6', 'request_id': 'req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:49.387580 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0d4cda468842aaa5f71f9c33f393d6', 'request_id': 'req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e'} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:49.400037 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] The token cache is being invalidate because project ab0d4cda468842aaa5f71f9c33f393d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:34:49.400327 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:49.402305 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: DEBUG keystone.notifications [None req-ddbb81b0-6999-49a2-a41e-bc34a77b0a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:34:49.402629 dv-cinder-836973-2-iscsi devstack@keystone.service[80226]: [pid: 80226|app: 0|req: 1468/2894] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Apr 11 13:34:49 2022] DELETE /identity/v3/projects/ab0d4cda468842aaa5f71f9c33f393d6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:36:39.001348 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Authenticating user token {{(pid=80227) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:36:39.002830 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:36:39.076019 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7031bd-d8b2-47b7-9516-6404ddc5b253 admin admin] Validating token access rules against request {{(pid=80227) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:36:39.135117 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5fb9818914042078c9fe53bfa51e6f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639c0c8a7c9e4390a007d1a82a290ab7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80227) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:36:39.136078 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] REQUEST_METHOD: `GET` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:36:39.136362 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] SCRIPT_NAME: `/identity` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:36:39.136644 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80227) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:36:39.138593 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.fernet_utils [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80227) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:36:39.150258 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:36:39.151877 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0449d-e9d2-4296-a7de-3f68654c9022 service placement] RBAC: Authorization granted {{(pid=80227) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:36:39.162930 dv-cinder-836973-2-iscsi devstack@keystone.service[80227]: [pid: 80227|app: 0|req: 1427/2895] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Apr 11 13:36:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)